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PREFACE 

This  report  was  prepared  by  Pijrduo  Urdversity,  School  of  Electrical 
Engineering,  Prof,  J.  E,  Gibson  acting  as  Principal  Inrestigator,  under 
USAF  Contract  No,  AF  29(600)-1933.  This  contract  is  administered  under 
the  direction  of  the  Guj.dance  and  Contr^''*  Division,  Air  Force  Missile 
Development  Center,  Holloman  Air  Force  Base,  New  Mexico  by  Mr,  J,  H,  Gengel- 
bach,  the  initiator  of  the  study. 
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FOREWORD 

Thia  is  the  fifth  and  last  report  to  be  completed  under  the  Air  Force 
Project  Number  AF  29(600)-1933«  The  task  specified  under  the  above  contract 
is  the  specification  of  linear  and  nonUnear  control  systems.  Toward  the 
achievement  of  this  purpose,  the  first  three  reports  deal  with  linear  control 
systems,  vdiile  the  last  two  concentrate  on  nonlinear  systems* 

Interim  Report  #1,  titled  "Specification  and  Data  Presentation  in  linear 
Control  Systems"  was  issued  in  July  of  1959 •  This  report  was  circulated 
through  the  control  industry  and  the  universities,  and  a  number  of  the  lead*- 
ing  industrial  concerns  in  the  country  were  visited  in  connection  with  the 
contents  of  this  report*  As  a  result  of  this  feedback,  the  basic  material 
of  this  interim  report  was  expanded  and  published  in  two  final  reports, 
namely.  Final  Report,  Volume  I,  "Specification  and  Data  Presentation  in 
Linear  Control  Systems,"  October  I960,  and  Final  Report,  Volume  II, 
"Specification  and  Data  Presentation  in  linear  Control  Systems,  -  Part  Two," 
May,  1961.  These  volumes  also  carry  the  Air  Force  Designation  AFMDC-TR-6l-5> 
Parts  One  and  Two*  The  first  of  these  final  reports  deals  with  the  specifi¬ 
cation  of  continuous  systems  which  can  be  described  by  linear  differential 
equations  with  constant  coefficients.  The  second  considers  Sampled  Data 
Systems,  linear  Time  Variable  Parameter  Systems,  and  Performance  Indicies. 

Final  Report,  Volume  III  is  a  tutorial  report  titled  "Stability  of 
Nonlinear  Control  Systems  by  the  Second  Method  of  liapxmov,"  and  dated 
May,  1961,  (AFMDC-TR-61-6) .  This  report  was  written  to  acquaint  the  interest¬ 
ed  reader  with  a  technique,  common  in  the  USSR,  that  will  serve  as  a  tool  in 
the  future  nonlinear  work,  and  not  as  a  direct  attack  on  the  nonlinear  con¬ 


trol  specification  problem 
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The  piresent  report  is  an  interim  report  which  reviews  the  status  of 
the  nonlinear  control  art,  and  specifically  the  area  of  nonlinear  control 
system  specification.  While  the  complexity  of  this  problem  is  at  least 
an  order  of  magnitude  greater  than  in  the  linear  case,  it  is  felt  that  the 
ideas  presented  here  form  the  foundation  from  which  a  more  detailed  and 
explicit  attack  on  the  general  nonlinear  specification  problem  may  be  built. 


ABSTRACT 


This  ie  an  interim  report  on  the  specification  of  nonlinear  automatic 
- - 

control  systeuns.  -i^^is  concerned  primarily  with  assessing  the  state  of  the 
art  of  nonlinear  control  as  a  prelude  to  the  solution  of  the  actual  specifi¬ 
cation  problem. 

As  an  introduction,  the  classical  methods  of  nonlinear  analysis  are 
discussed,  and  the  reasons  for  the  inadeqtiacy  of  these  techniques  for  auto¬ 
matic  control  systems  are  explained.  The  two  generally  known  methods  of 
analyzing  the  stability  of  autonomous  nonlinear  control  systems^  namely 


phase  plane  analysis  and  the  describing  ftuiction,  are  discussed^ and  a 
summary  of -^tie  '^pabilities  and  limitatioi^ ofiEdttpuney  *  s  Becnfi^  Method  is 
presented.  The  concept  of  the  state  yariable  and  the  state  space  is  intro¬ 


duced  in  some  detail,  as  it  is  expected  that  this  will  be  the  medium  through 
which  the  '  i  response  of  the  majority  of  nonlinear  systems  will 

be  handled.  The  stability  of  the  nonautonomous  systea^is  also  discussed  from 
the  point  of  view  of  signal  stabilization  and  the  dual  input  yue scribing 


function,  - - -  .1.*^ 

It  is  pointed  out  that  in  addition  to  the  stability  of  a  nonlinear  sys¬ 
tem,  its  response  jio  a  given  input  is  of  particular  interest.  Chapters  3  and 

^  O/Sli  fj'T  ' 

4  are  devoted  to  the  response  of  autonomous  and  nonautonomous  systems^j  As  a 
criterion  for  specification,  the  time  optimum  system  is  stressed,  and  dis¬ 
tinction  is  made  between  the  solution  of  the  time  optimum  problem  as  a  per¬ 
formance  index  and  the  synthesis  of  the  optimum  switching  boundaries.  The 
phase  plane  is  discussed  for  forced  systems  and  the  work  of  Vfi.ener  is  mention¬ 
ed  in  connection  vdth  the  response  of  nonlinear  systems  to  random  inputs. 
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CHAPTER  I 

INTRODUCTION  TO  NONLINEAR  CONTROL  SYSTEMS 


1.1  Introduction 

All  physical  systems  are  nonlinear,  although  in  many  systems  this  non¬ 
linear  effect  is  so  slight  that  satisfactory  results  are  obtained  with 
linear  models.  Many  physical  systems  are  nonlinear  simply  due  to  the  lack 
of  component  perfection.  However,  a  significant  ntimber  of  systems  are  non- 
lear  through  conscious  design.  Many  times  a  nonlinear  system  will  be 
lighter,  cheaper,  more  reliable,  easier  to  fabricate  and  have  better  per¬ 
formance  than  an  equivalent  li.near  system »  Thus  it  is  of  great  importance 
to  the  Air  Force  that  nonlinear  control  systems  be  properly  specified. 

This  is  an  interim  report  on  the  specification  of  nonlinear  automatic 
control  systems.  It  has  three  objectives: 

a)  to  shew  why  classical  nonlinear  mechanics  has  not  provided 
the  tools  needed  by  the  automatic  control  engineer  thus  far, 

b)  to  assessthe  present  state  of  the  nonlinear  automatic  control 
art, 

c)  to  point  out  the  directions  future  work  will  take, 

1.2  Classical  Nonlinear  Mechanics  and  Nonlinear  Analysis  as  Applied  to 
Automatic  Control 

Classical  nonlinear  mechanics  has  generally  been  used  for  the  analysis 
of  nonlinear  problems.  For  some  few  problems  it  has  been  possible  to  find 
closed  form  solutions  in  terms  of  the  simpler  functions.  Generally,  how¬ 
ever,  this  attack  fails,  A  number  of  books  have  been  written  on  special 
nonlinear  differential  equations  and  it  would  not  be  difficult  to  fill  re¬ 
port  after  report  with  such  considerations.  This  is  not  necessary,  however. 
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nor  would  it  even  be  proper,  since  seldom,  if  ever,  will  it  be  possible  to 
arrange  even  a  moderately  complex  control  system  into  a  form  which  would 
make  use  of  available  solutions*  This  is  not  to  say,  of  course,  that  a 
background  of  such  techniques  will  not  prove  valuable  to  a  designer.  In 
fact  it  is  obvious  that  in  a  difficult  field  such  as  nonlinear  automatic 
control  it  is  desirable  to  have  as  imich  training  as  possible. 

It  has  been  long  realized,  of  course,  that  closed  form  solutions  to 
nonlinear  differential  equations  ar«  difficult  to  obtain  and  exist  for 
only  a  few  special  classes.  For  100  years  or  more  analysts  have  been 
concerned  with  the  approximate  solution  of  nonlinear  differential  equa¬ 
tions,  Such  series  approximation  techniques  as  perturbation  and  reversion 
are  well  known.  Other  methods  such  as  variation  of  parameters  and  harmonic 
balance  are  also  widely  used.  The  mathematical  justification  of  these 
methods  generally  requires  that  the  nonlinear  variation  be  small  and/or 
slow  and/or  smooth.  Sometimes  the  engineer  is  faced  with  nonlinear  con¬ 
trol  systems  in  which  none  of  these  restrictions  are  valid  and  simulation 
is  the  only  practical  solution.  It  is  apparent  that  classical  exact 
solutions  are  of  little  value, 

A  number  of  excellent  texts  are  available  that  will  introduce  the 
engineer  to  nonlinear  analysis.  The  recent  book  by  Cunninj^am  [l]  is 
notable  for  the  clarity  of  presentation  and  the  numerous  worked  examples* 
Other  well  known  beoks  are  those  by  Stoker  [2],  Minorsky  [3]  and  Andronow 
and  Chaikin  [4] .  Somewhat  more  intense  mathematically  are  the  books  by 
Lefschetz  [5]  and  Bellman  [6], 

1,3  Approximate  Methods  for  Nonlinear  Control 


Modern  approximate  techniques  of  nonlinear  system  analysis  art  direct 
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outgrowths  of  classical  analysis,  and  one  could  probably  relate  them 
directly  to  Poincare’  and  Liapunov,  if  thei'e  was  any  point  in  so  doing. 
This  discussion  will  be  avoided  by  pointing  out  that  the  newness  lies 
in  the  emphasis  and  phrasing  of  the  problem  and  the  prominence  of  geo¬ 
metric  and  graphical  interpretation,  but  not  in  techniques  of  analysis. 

Chapter  2  of  this  report  considers  the  more  important  of  these 
techniques  in  detail,  so  they  need  not  be  discussed  here. 

The  state  of  the  art  in  the  analysis  and  synthesis  of  nonlinear 
control  systems  is  unsatisfactory,  especially  in  its  lack  of  generality. 
It  is  almost  impossible  to  rely  on  a  single  analysis  to  illustrate  all 
of  the  possible  phenomena  that  can  occur  in  a  single  system.  For  ex¬ 
ample,  it  takes  a  different  analysis  to  demonstrate  jump  piienomena  than 
it  does  to  show  subharmonic  oscillation  or  frequency  entrainment  for  the 
same  system.  It  does  not  appear  that  this  condition  will  change  in  the 
near  future,  because  approximate  analysis  is  not  completely  reliable, 
and  some  other  method  must  be  used  to  supplement  the  analysis  of  a  non¬ 
linear  control  system.  This  other  approach,  widely  used  now,  is  computer 
simulation  which  is  discussed  in  the  next  section, 

1,4  Computer  Simulation 

The  major  emphasis  in  this  report  is  on  analysis,  because  it  is  de¬ 
sired  to  obtain  an  understanding  of  s3rstems  in  general  to  facilitate  the 
evaluation  and  specification  problem.  However,  it  is  recognized  that 
engineers  use  computer  simulation  for  nonlinear  system  analysis  more  than 
they  use  mathematical  methods.  There  are  several  reasons  for  this, 

1,  Mathematical  methods  are  not  available  or  are  not  tractable  for 
the  determination  of  system  response.  It  is  usually  less  ex- 


pensive  to  obtain  a  transient  response  on  a  computer  than  by 
analysis. 

2.  In  a  nonlinear  system  complete  knowledge  of  any  particxxlar  re¬ 
sponse  does  not  necessarily  imply  knowledge  of  any  other  response. 
Thus,  it  may  be  necessary  to  obtain  thousands  of  responses  to 
establish  confidence  in  a  design.  This  makes  all  but  the  simplest 
calculations  uneconomical. 

3»  Actual  systems  are  often  much  more  difficult  to  analyze  than  simple 
text  book  examples.  It  may  be  necessary  to  include  some  actual 
pieces  of  hardware  in  the  simulation  if  they  can  not  be  described 
adequately.  Analysis,  of  course,  is  not  this  flexible. 

4.  Engineers  who  do  design  woric  may  not  be  aware  of  the  mathematical 
tools  available  for  design  and  evaluation, 

5.  Design  engineers  are  usxially  more  interested  in  a  specific  syntem 
than  general  trends  which  are  available  from  mathematical  analysis. 
Hence,  a  thorough  simulation  is  often  adequate  for  their  purposes. 
For  example,  the  parameters  of  a  simulated  system  can  be  varied  and 
the  resulting  response  observed  for  system  synthesis. 

The  present  inadequacy  of  nonlinear  analysis  should  not  lead  one  to 
abandon  all  attempts  at  analysis  and  to  a  complete  reliance  on  computer 
simulation;  a  combination  of  simulation  and  analysis  seems  more  nearly 
optimum  than  simulation  alone.  Some  analysis,  even  with  incomplete  or  in¬ 
exact  models,  will  yield  insist  not  always  available  from  simulation. 

Major  advances  in  theory,  and  hence  hardware,  will  be  dela3red  if  attention  is 
not  given  to  the  mathematical  treatment  of  systems. 

Thus  the  tentative  reconaiendation  of  the  Purdue  group  will  no  doubt  in- 


volve  a  parallel  use  of  computer  simulation  and  modern  approximate  ana¬ 
lytical  techniques  for  the  specification  of  nonlinear  control  systems, 

1,5  Future  Trends 

In  each  of  the  following  chapters  an  assessment  of  the  importance 
upon  future  developments  of  the  techniques  discussed  is  given.  In  fact, 
because  of  the  present  incompleteness  of  existing  techniques,  a  great 
deal  of  space  in  this  report  seems  to  be  given  over  to  damning  the  status 
quoo  This  may  be  interpreted  as  an  imdesirable  situation  and  to  provide 
cause  for  discouragement.  The  Control  and  Information  Systems  laboratory, 
on  the  other  handj,  feels  that  specifically  pointing  out  the  deficiencies 
means  that  we  have  at  least  progressed  to  the  point  where  we  recognize  the 
problem.  This  could  not  have  been  said  of  most  automatic  control  engineers 
as  late  as  4  or  5  years  ago. 

The  reader  of  this  report,  especially  if  he  has  been  concerned  with 
automatic  control  systems  for  a  decade  or  more,  will  recognize  an  almost 
revolutionary  change  in  techniques  and  emphasis  compared  with  what  mi^t 
be  called,  "Classical  Automatic  Control",  This  is  the  collection  of  tech¬ 
niques  available  in  almost  all  of  the  texts  in  English,  The  "New  Automatic 
Control"  is  more  advanced  mathematically  and  calls  upon  the  digital  computer 
as  an  on  line  element  more-and-more  frequently.  It  works  frequently  in  a 
non-physical  state  space  and  attempts  to  find  the  theoretical  limits  of 
performance  based  upon  ultimate  physical  limitations  on  the  system,  such 
as  finite  energy  or  torque  or  velocity,  but  without  consideration  of  the 
detailed  construction  of  any  particvilar  configuration.  In  other  words,  the 
optimum  problem  becomes  important.  The  ultimate  time  optimum  systems  are 
studi.ed  and  the  self  optimizing  or  adaptive  problem  is  of  concern. 


The  "New  Autoaatic  Control"  is,  as  yet,  essentially  an  academic 
discipline*  The  reader  will  see  that  few  if  any  practical  systems  hare 
benefited  as  yet  from  this  approach*  However,  only  5  to  10  years  after 
the  classical  autoaatic  control  matured  in  the  early  1940 *s,  it  became 
an  essential  part  of  engineering  system  design*  It  seems  entirely 
possible  that  the  1960’s  will  witness  a  similar  impact  on  industrial 
^d  aerospace  system  design  due  to  the  "New  Automatic  Control"* 

When  reading  a  cane  of  the  mathematical  work  contained  in  the  report, 
the  reader  shcmld  keep  in  mind  that  a  mathematical  treatment  of  a  problem 
is  usually  the  starting  point  for  engineering  effort,  rather  than  a 
practical  problem  solution*  For  example,  while  the  formal  solution  is 
desired  for  the  general,  time  varying,  optimum,  switched  system  problem, 
it  must  be  realized  that  practical,  general  problems  are  either  not 
mathematically  tractable  or  are  trivial*  In  addition,  it  should  be 
pointed  out  that  practical  aspects  of  the  problem  such  as  end  point 
switching,  instrument  imperfections,  etc*  have  not  been  included  in  the 
general  formulation*  This  single  example  serves  the  purpose  of  illustrating 
the  obvious  —  much  research  remains  to  be  done  in  the  nonlinear  area  of 


control  systems 
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CHAPTER  II 

STABILITY  OF  AUTONOMOUS  SYSTEMS 


2»1  Introduction 

The  word  "stability"  is  frequently  interpreted  by  engineers  as  that, 
property  of  a  system  \Aich  yields  a  bounded  response  to  any  bounded  input 
or  load  disturbance.  While  such  interpretation  is  correct  in  linear, 
stationary  systems,  it  may  easily  lead  one  to  erroneous  conclusions  in 
the  case  of  nonlinear  systems.  In  nonlinear  stationary  systems  the 
"boundedness"  of  response  to  bounded  inputs  no  longer  guarantees  that  the 
unforced  system  response  will  return  to  the  equilibrium  state  asymptotically 
in  time.  Neither  is  the  converse  time  (i.e.,  asymptotic  stability  does  not 
always  imply  total  stability  or  stability  in  the  presence  of  bounded  inputs 
and/or  load  disturbances). 

Additional  complications  arise  due  to  the  fact  that  in  nonlinear  sys¬ 
tems  stability  of  an  equilibrium  state  is  no  longer  a  global  concept  but  only 
a  local  system  property  (i.e,,  a  nonlinear  system  may  be  stable  for  sufficient¬ 
ly  small  initial  disturbances  and  become  unstable  because  of  a  sufficiently 
large  disturbance,  and  vice  versa).  Furthermore,  it  is  conceivable  that  a 
nonlinear  system  may  be  stable  for  certain  bounded  inputs  and  become  unstable 
for  other  bounded  inputs.  Hence,  in  the  analysis,  synthesis,  and  specifica¬ 
tion  of  nonlinear  automatic  control  systems,  total  stability  (i.e,,  stability 
in  the  presence  of  any  bounded  input  or  disturbance)  is  the  ultimate  (al¬ 
though  not  always  necessary)  goal.  Nevertheless  there  are  several  important 
reasons  why  the  stability  of  autonomous  (unforced,  stationary)  control  sys¬ 
tems  is  of  considerable  importance: 
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1)  It  is  important  to  know  the  behaviovir  of  the  system  in  the  absence 
of  inputs  and  load  disturbances* 

2)  In  the  presence  of  constant  inputs  and/or  constant  load  disturbances 
a  nonlinear  control  system  can  still  be  described  by  a  set  of  auto¬ 
nomous  differential  equations, 

3)  Stability  of  the  equilibrium  state  (i.e,,  stability  in  Liapunov 
sense)  or  boundedness  of  unforced  stationary  system  response  (i.e,, 
stability  in  Lagrange  sense  (La  Salle  [?]  )  implies  boimdedness  of 
the  response  to  boimded  inputs  or  total  stability  in  most  (if  not 
all)  physical  systems. 

This  chapter  is  devoted  to  a  discussion  of  the  more  general  or  more 
prondaing  methods  of  stability  analysis  of  nonlinear  autonomous  systems, 

2,2  The  Describing  Function  Method  of  Analysis 

The  describing  function  (D.F.)  method  of  analysis  is  appealing  from  a 
practical  point  of  view  because  it  is  an  attempt  to  linearize  a  certain  class 
of  nonlinear  systems  and  then  apply  the  methods  of  linear  system  stability 
analysis.  Engineers  are  accustoiBed  to  making  simplifying  assumptions  and 
using  linearized  models  for  the  analysis  and  synthesis  of  nonlinear  systems. 
The  D.F.  is  based  on  the  method  of  harmonic  balance  (Kryloff  [8]),  (Cunning¬ 
ham  [l]).  Several  papers  (Goldfarb  [9]),  (Kochenburger  [lo]),  (Tustin  [ll]  ) , 
(Oppeit  [12] )  have  advanced  this  idea.  The  most  common  describing  function, 
or  the  so-called  equivalent  gain,  is  defined  as  the  complex  ratio  of  the 
amplitude  of  the  fundamental  component  of  the  output  of  a  nonlinearity  to  the 
amplitude  of  the  input  to  the  nonlinearity  when  the  input  is  sinusoidal.  Re¬ 
strictions  such  as  low  pass  filtering  must  be  met  by  the  system  for  the 
analysis  to  be  valid,  A  detailed  discussion  of  the  method  is  unnecessary  here 
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since  the  D.F.  is  one  of  the  most  weU.  known  methods  available  for  the 
analysis  of  autonomoiis  nonlinear  systems* 

The  D.F.  method  can  be  used  to  determine  the  stability  of  an  auto¬ 
nomous  system  and  provides  a  designer  with  the  information  necessary  to 
synthesize  stabilizing  networks.  If  an  autonomous  system  has  a  stable 
limit  cycle,  the  approximate  amplitude  and  frequency  of  the  first  harmonic 
term  of  the  oscillation  can  be  predicted.  It  is  possible  to  obtain  higher 
harmonic  correction  terms  (Johnson  [13]  )  which  improve  the  accuracy  of  the 
method.  The  work  required  to  calculate  the  correction  terms  is  generally 
not  justified  because  these  terms  are  relatively  small  in  systems  which 
possess  adequate  low-pass  filter  characteristics.  Their  main  utility  is 
the  confidence  established  in  the  validity  of  the  D.F.  if  these  correction 
terms  are  relatively  small.  Gille,  et  al.([l4],  p  43)  point  out  that  cases 
are  unusiial  where  the  error  introduced  in  neglecting  the  higher  harmonic 
terms  exceeds  10  per  cent,  and  that  the  accuracy  of  limit  cycle  frequency 
obtained  from  the  D.F.  is  usually  better  than  5  percent, 

Levinson  [l5j  and  other  investigators  (Hill  [l6] )  have  used  the  de¬ 
scribing  function  to  predict  the  closed  loop  frequency  response  of  station¬ 
ary  nonlinear  systems.  By  writirig  a  quasi-linear  error  transfer  function 
and  solving  (usually  by  means  of  a  computer  or  graphical  techniques)  for  a 
value  of  error  which  satisfies  this  quasi-linear  transfer  function,  error 
is  determined.  Knowing  the  error,  the  response  may  then  be  found.  Multiple 
roots  of  the  solutions  of  the  above  transfer  function  yield  information 
about  the  jump  phenomena  of  the  system,  Thiis  is  a  laborious  process  and 
different  results  are  obtained  for  different  amplitudes  of  the  input,  since 
the  system  is  nonlinear.  This  method  is  valid  only  for  nonlinear  systems 
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that  are  totally  stable.  If  this  point  is  not  recognized,  it  is  possible 
to  obtain  erroneous  results.  Further  discussions  regarding  frequency  re¬ 
sponse  of  nonlinear  systems  are  given  in  the  section  on  Dual  Input  Describ¬ 
ing  functions  in  the  next  chapter. 

The  D.F.  method  continues  to  be  a  vehicle  for  nonlinear  research  as 
well  as  design.  Perhaps  the  major  disadvantage  of  the  method  is  that  it 
is  limited  to  frequency  analysis.  Of  course,  other  methods  share  this 
deficiency  also. 

Tsypkin  j^l*^  has  presented  a  method  equivalent  to  the  D.F.  method  for 
the  exact  analysis  of  unforced  on-off  (relay)  systems.  This  method  retains 
all  harmonics  generated  by  the  nonlinear  elements  When  harmonics  are 
neglected  and  only  the  fundamental  component  of  the  output  of  the  nonlinear 
element  is  used,  this  method  reduces  to  the  conventional  describing  function 
method  of  analysis.  The  use  of  this  method  is  not  warranted  in  systems  which 
possess  stifficient  high-frequency  attenuation  such  that  the  approximate  de¬ 
scribing  fxinction  method  of  analysis  is  adequate.  Furthermore,  the  method 
of  Ts3rpldLn  is  practical  only  with  very  simple  nonlinearities ,  such  as  a  re¬ 
lay,  and  cannot  be  applied  to  more  general  types  of  nonlinear  systems, 

2.3  Phase  Plane  Analysis 

The  phase  plane  method  of  analysis  is  applicable  directly  to  only  second 
order  nonlinear  autonomous  systems.  This  method  consists  of  investigating 
the  behavior  of  the  trajectories  of  system  response  in  the  plane  of  some 
system  variable  and  its  first  time  derivative.  A  detailed  discussion  of  the 
phase  plane  method  of  analysis  car.  bi  found  in  many  textbooks  on  nonlinear 
analysis  j^lj . 
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A  generalization  of  the  phase  plane  analysis  is  the  analysis  in  the 
phase  space,  i.e*,  in  the  space  of  a  variable  of  the  system  and  its  n-1 
time  derivatives  where  n  is  the  order  of  the  system.  Unfortunately,  the 
amount  of  labor  involved  in  constructing  the  phase  trajectories  in  systems 
of  higlier  than  second  order  is  prohibitive  [l8]  •  Hence  the  practical  use 
of  the  phase  space  (phase  plane)  method  of  stability  analysis  is  limited 
to  only  the  second  order  autonomous  nonlinear  systems, 

2,4  The  Concept  of  State  Space 

Before  proceeding  with  the  analysis  and  synthesis  of  a  control  system, 
one  has  first  to  find  a  mathematical  description  of  such  a  system.  In 
stationary  linear  systems  this  is  usually  accomplished  by  first  expressing 
the  interrelationships  between  various  variables  of  the  system  in  terms  of 
lineal’  differential  equations  with  constant  coefficients.  Then  these 
differential  equations  are  changed  (by  means  of  the  Laplace  transform  or 
other  integral  transforms)  into  transfer  fimctions  and  combined  to  yield 
an  overall  transfer  function. 

In  nonlinear  systems  the  Laplace  transformation  is  no  longer  applicable, 
and  thus  the  mathematical  description  of  the  system  must  be  retained  in  the 
form  of  differential  eq’aations.  The  most  convenient  form  for  many  piirposes 
is  a  description  of  the  system  by  means  of  n  first  order  differential  equa¬ 
tions,  This  can  always  be  done  in  a  strai^t-forward  manner  by  properly 
identifying  the  variables  appearing  in  the  system.  The  number  of  independ¬ 
ent  first  order  differential  equations  is  equal  to  the  order  of  the  system 
(ioC,  to  the  order  of  a  single  differential  equation  describing  the  system). 
The  set  of  n  independent  first  order  equations  completely  describes  the 
state  of  the  system  at  any  time  t.  Hence  a  set  of  n  linearly  independent 
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Tariables  will  bo  referred  to  as  a  set  of  state  variables  and  the  Euclidean 
space  of  these  state  variables  as  toe  state  space.  One  may  note  that  an 
infinite  number  of  state  variable  sets  may  be  chosen  to  represent  the  same 
system.  Probably  the  simplest  set  of  sta-e  space  variabl-'s  is  the  set  of 
phase  space  variables  (Sec,  2.3), 

To  assist  in  the  design  and  analysis  of  nonlinear  systems  a  standard 
form  for  the  differential  equations  and  the  system  block  diagram  (if  appli¬ 
cable)  is  used  in  terms  of  variables  that  are  not  necessarily  those  of  the 
physical  system.  The  term  “canonic  form”  is  used  frequently  and  inter¬ 
changeably  with  the  term  "standard  form".  It  implies  one  of  several  of  the 
simplest  and  most  significant  forms  to  which  general  equations  may  be 
broi^ght  without  loss  of  generality.  The  form  is  mathematically  convenient 
and  the  advantages  of  such  a  form  out-weigh  the  advantages  of  retaining 
the  system  j^ysical  variables.  It  is  often  convenient,  in  fact,  to  write 
the  equations  of  any  system,  linear  or  nonlinear,  of  high  or  of  low  order, 
in  such  a  'anonical  form. 

The  principal  characteristic  associated  with  systems  in  canonical 
form  is  that  the  different  variables  are  "separated",  i,e,  each  of  the  n 
first  order  differential  equations  contains  only  one  variable,  or  if  this 
is  not  possible,  some  may  contain  two  variables, 

A  particular  form  of  the  system  variables  may  be  chosen,  therefore, 
so  that  the  system  equations  in  terms  of  these  variables  will  reduce  to  the 
standard  or  canonical  form.  The  new  variables,  associated  with 

the  canonical  form  of  the  system  equations,  are  related  by  a  linear  trans¬ 
formation  to  the  system  physical  variables  (x^,  that: 
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In^n 


^  -  Pnin  +  . ^ni/n 

or  in  matrix  notation  (Pipes  [l9l ,  Chapter  4) 

W  •  [p 


(2.1) 


or 


{7}  -  [P]-^{x} 


(2.2) 


(2.3) 


v^ere 


[p]  -  a  square  nxn  matrix  with  elements  P^^j 


-1 


inverse  of 


f] 


^yj-  -  a  nxl  matrix  with  elements  y^ 

^xj  ~  9.  nxl  matrix  with  elements 

The  theory  of  linear  transformations  indicates  that  the  basic  properties  of 
the  system  (e.g,  the  characteristic  roots  or  eigenvalues  of  the  system  linear 
portion)  are  identical  in  either  set  of  variables  [3j  ,  p.  89). 

In  the  language  of  a  positional  control  system,  one  new  variable  could 
be  defined  in  the  form; 

yj^  “  Px  +  Qv  +  Ra  where  x  »’  poi^ition  (2.4) 

V  -  velocity 
a  ■  acoeloration 
P,Q,R  -  constants 

This  example  indicates  that  the  physical  meaning  of  the  new  variables  usually 
is  obsciire.  The  mathematical  simplification  that  results  is,  however,  of 
considerable  importance. 


With  the  physical  meaning  of  the  new  variables  obscure,  one  can,  with 
very  little  further  effort,  consider  them  to  be  measured  in  Euclidean  n-space 
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along  a  set  of  n  mutually  perpendicular  axes.  We  have,  therefore,  the 
vector: 


"^1 


-  -  72ay2  ^ 


(2,5) 


c 


where  the  a.^  are  unit  vectors  defining  the  axes  in  n-space.  This  vector 
in  n-space  describes  the  state  of  the  system  completely. 

There  are  an  infinite  number  of  square  matrices  [p]  that  will  perform 
a  linear  transformation  on  the  physical  variables,  X]^..,.x^.  The  choice  of 
[p]  is  criticaJ ,  therefore,  in  that  it  defines  the  canonical  form  in  which 
the  system  equations  are  written. 

The  procedure  that  can  be  followed  to  select  the  matrix  [p]  will  be 
described  by  using  a  particular  example.  Consider  the  closed-loop  system 
with  separable  nonlinearity  as  shown  in  Figure  2,1.  It  is  assumed  that  the 
differential  equations  for  the  actual  system  have  been  written  and  expi’^ssed 
in  the  form  shown  in  this  figure.  From  this  form  the  following  relations 
can  be  written: 


Ei^(s)  -  Ri(s)  -  Xi(3) 


(2,6) 


XiCs)  I 

U(s)  s(s  +1)  (s  +  2) 

which  when  combined  and  transformed  to  the  time  domain  give: 

d^e  3d^e^  2de  d^r  3d2r  2dr 

- ”  ("•l)u  +  ■ -IT  +  '  y  *  +  — — 

dt^  dt  dt  dr  dt  dt 


(2.7) 


(2.8) 
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The  Conventional  Block  Diagram  of  a  Closed  Loop 
System  vd.th  a  Separable  Nonlinearity  (top) 
and  Eqvdvalent  Block  KLagraa  (bottaa) 
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For  a  given  input  r(t),  the  quantit7  d^r  ^  3d^  ^  2dr  is  knovm 

^  d?"  dt 


and  will  be  abbreviated  f(t). 

New  variables  are  now  introduced. 


®2  - 


dt 


and  e-: 


Hr 


(2.9) 


50  that  equation  2,d  can  be  re-written: 


de 


■  (O)  e^^  +  (l)e2  ^  (0)e^+(0)u  +  (0)f 


de 

dt 


-  -  (O)  e^^  +  (0)e2  +  (l)e^+(0)u  +  (0)f 


de 


»  (0)  e^^  +  (-2)e2+(-3)e3+(-l)u  +  (l)f 


or 


r  " 

““  • 

-  -N 

r  n 

« 

®i 

0  10 

®1 

0 

0 

• 

®2 

V  . 

0  0  1 

®2 

0 

0 

'1 

cv 

1 

?3. 

-1 

f 

^  -J 

which  in  matrix  notation  becomes: 


(2.10) 


(2.11) 


{;}  -  [A]{e}  *  [B]{u>  .  (f)  (2.12) 

Any  sjstems  which  are  linear  in  the  sense  that  the  elements  being  controlled 
are  linear  and  where  the  steering  function,  u(t),  enters  linearly  as  a  function 
of  time  can  be  reduced  to  a  similar  form.  In  this  example  the  j^Aj  matrix, 
the  system  matrix,  has  elements  that  are  constants  because  the  linear  portion 
of  the  system  had  constant  coefficents.  If  the  linear  portion  of  the  system 
had  been  time  varying  the  matrix  elements  would  have  been  time  varying.  In 
general  the  [b]  matrix  would  be  nxr  and  the  -^uT  vector  of  ditaension  rj  in 


tnis  example  r  •=  1 


1?  - 


It  is  emphasized  that  "while  any  system  will  reduce  to  the  form  of 
equation  (2,12)  the  details  of  the  equation  are  not  imique  for  a  given 
system.  If  Figure  2,1  is  rearranged  as  in  Figure  2.2,  equation  (2,11) 
becomes s 


r  “1 

r  'I 

“  " 

o 

1 

o 

e« 

0 

1 

1 

0 

^'2 

>  , 

0-1  1 

*2 

?  +  ^ 

or 

e' 

<N 

1 

O 

o 

e« 

1 

3 

-J 

j\ 

u  + 


(2.13) 


where  g  «  ^  «  This  equation  obviously  has  the  same  form  as  equation 
dt 

(2.11)  but  differs  in  detail. 

Thus  far  the  variables  used  are  close  to  the  physical  variables, 
though  they  may  not  be  available  directly  in  the  system.  Should  the 
system  have  zero  input  the  equations  can  be  written  directly  in  terms  of 
the  output  and  its  derivatives,  Returning  to  Figure  1  and  set¬ 

ting  r(t)  =  0,  the  following  equation  can  be  derived  to  replace  equation 

(2.11) . 

r  r—  — , 


0 


1 


0 


0 


0 


Xr 


0  r  u 


(2,.U) 


0 


-2 


+1 


or 

fi}  .  [a]{x}  -  [bJ  (u)  (2.15) 

The  details  of  equation  (2,14)  are,  of  course,  not  unique  either. 

The  new  variables  |^y^  associated  with  the  state  space  to  be  used  and 
related  to  the  existing  variables  or  i^e|  by  equations  (2,7)  and  (2,S) 


Figure  2.2 

The  System  of  Figure  2,1  Redrawn 
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must  now  be  found.  The  form  of  the  matrix  [p]  must  be  determined  on  the 
basis  that  the  equations  will  transform  into  a  form  that  is  mathematically 
convenient.  There  are  a  number  of  techniques  available  that  will  yield 
the  elements  of  this  matrix.  Other  methods  yield,  directly,  the  system 
impulse  response  matrix  [h]  which  will  be  used  and  defined  later  in  this 
section.  The  methods  are,  for  example:  The  classical  method  of  separation 
of  variables  (  [l9]  ,  Chapter  4,  Section  20):  The  general  solution  by  La- 
grangeb  method  of  variation  of  parameters  which  fields  the  [h]  matrix 
directly  (La  Salle  [20]  ,  Section  2),  (Bellman  [2l]  ,  Chapter  10,  Section  12): 
The  method  reported  by  Kalman  [22]:  Lur*e*s  canonical  form  and  the  psuedo 
canonical  form  ([23]  Chapter  2):  Solution  in  terms  of  the  Jordan  canonical 
form  (Kaplan  [24]  ,  p,  289):  A  sxunmary  and  variations  on  several  methods  by 
Kurzweil  [25]  . 

The  example  system  chosen,  described  by  equations  (2,11)  and  (2,14), 
is  characterized  by  the  fact  that  the  linear  portion  has  real,  distinct 
poles,  i,e,  the  system  matrix  ^a]  has  real,  distinct  eigenvalues  given  by 
the  solution  of  the  equation  j|^Aj  -  X[^]l  “  ^  (W  P»  S8),  The  method  to 
use  in  the  determination  of  the  matrix  [pj  depends,  as  is  described  in  the 
above  mentioned  references,  on  the  form  of  the  system  differential  equations. 
In  this  case,  the  example  of  equations  (2.11)  and  (2.14),  the  classical 
method  can  be  used. 

The  solution  of  the  equation  |[Aj  -/\[^]1  *  ®  yields  the  three  values 
of  X  :  X^  ■  0,  X2  »  ~1  and  X-j  -  -2, 

The  solution  of  the  matrix  equation: 

[A-Xil]{Pi)  -0 


(2.16) 
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where  the  vector 


il 


i2 


13 


is  an  eigenvector  associated  with  the  eigenvalue  for  i  -  1,  2  and  3 
will  give  the  three  columns  of  the  matrix  [p]* 

With  i  “  i,  -  0  gives 


U 


0 


P13.O 

■*^^12  *■  ^^13 

This  yields 

fa' 


0 


{”1} 


where  a  is  an  arbitrary  real  number. 
Then  i  *  2,  ■  -1  gives 

-  0 


P21  +  P22 

P22  +  P23 
-2  P22  -2  P23 


This  yields 


-  0 
-  0 


f^a] 


-b 

b 


where  b  is  an  arbitrary  real  number. 
Then  i  =  3,  X3  “  ~2  gives 

-  0 
-  0 


2^31  P32 


2P32  +  P33 


-2P32  -  IP33  -  0 


(2.17) 


(2.18) 


(2.19) 
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This  yields 


{P3]  .  <^-c/2 


where  c  is  an  arbitrary  rea^.  ntimber. 

The  matrix  is  therefore  given  be]ow  together  with  the  inverse  matrix: 


a  b  c/4 

0  -b  -k:/2 
0  b  c 


1/3  1 


-1/b 


[0  b  c  J  [0  2/c  -2/c 

Substituting  the  transformation  [^e]-  ■  [pj  into  equation  (2,12) 
[p][y]  -  [A][P]{j}  ♦  [b]{u}  +  {f} 

0  -  [prtA][p]fy> 

(;}  -  M  7  *  M  {u}  *  [p]-i  (f) 

For  the  example  ^/\^  can  now  be  calculated  easily  as: 

[b  0  0l 


0  0-2 


(2.20) 


»  0  -1  0  which  is  independent  of  the  constants  a,  b,  and  c. 


and  choosing  for  convenience  a  •  -  i,  b  ■  1  and  c  >*  2  then: 


1  >  and  [Pj-l  {f}  -  [q]  (f) 


In  terms  of  the  new  variables,  the  canonic  state  variables  >  equation 
(2.11)  can  be  written: 
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0-1  0 

4 

>  ♦  < 

1 

>  u  4  4 
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V.  J 
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C  J 

-f 

(2.21) 


Thli  if  A  oanonloAl  form  for  tho  orifiiul  oquAtlon  which  !■  oonyenitnt 
BLAthomiitioAlly  Af  th*  VAriAbltt  Ar«  AopArAtod  And  tho  conotAnto  hATo  boon 
roduood  to  unity. 

Consider  a  component  oquAtion  of  tho  loot  fora  of  oquAtion  (2.20) i 


7i  ■  hji  *  2  '<fik«k  ♦  2  Qijfj 
k  j 


(2.22) 


this  equAtion  is  intogTAblo  if  the  functions  14^  And  f^  Are  roAl  And  moAsure- 
able  and  if  tho  initial  condition  vector  ^y(0^  is  known. 

Multiply  (2.21)  b>’  0"^^  thont 


and 


7l 


k  ^ikV^  ♦ 


Qijfjdr 

or,  returning  to  matrix  notation,  tho  general  solution  ist 


(2.23) 


(2.24) 


{y}  •  [o](y(o))  .  [o]f^  [0]  [<»]■'[']''«  « 

(2.25) 

Tho  natrix  [o]  is  called  the  ''system  impulse  response  matrix"  and  is  defined! 


-  23  - 


•  [^]  *  M  t 


2  2 


21 


(2.26) 


for  linear  systeraa  in  canonical  form. 

Transform  equation  (2,24)  back  to  the  original  variablee  using  ^3^  ■ 

[o](Cortpffr).t^.  (a.a7) 

and  multiply  by  [p]  and  introduce  [p]  [p]  into  the  integral  terns i 


0 

[p][o][p]‘YV]['»]"Vrtf}  -ir  (2-28) 

Now  writing  [h]  ■  [p][o][p]  and  therefore 

[h]'^  -  [p][o]*V]'^  (2.29) 

equation  (2,29)  becomest 

{«}  ■  [w]{»(os » «  (2,30) 

The  matrix  [h]  is  now  the  system  impxilse  response  matrix  in  terms  of  the 
origj.nal  variables  e]^,,..,e„  and  is  defined  in  terms  of  the  system  matrix  [xjt 

[H]  .  -  [1]  »  [A]t  »  . 

A  system  impulse  response  matrix  [h]  can  always  be  obtained  from 
knowledge  of  the  system  matrix  [a^.  The  system  matrix  [a^  cannot  always 
be  diagonalized,  to  yield  the  matrix  [a]  ,  however,  unless  the  eigenvalues 
are  real,  and  distinct.  The  matrix  [a]  can  always  be  put  into  the  Jordan 
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canonical  form,  using  a  suitable  transformation  ([24],  p.  28?)  (  [2l] , 
p«  191)  and  the  resiilting  equations  in  terms  of  canonic  state  variables 
can  be  integrated. 

Returning  to  the  example  of  this  section  for  a  moment  and  writing 
equation  (2.21)  in  component  form  gives  the  three  equations: 

• 

-  (0)72^  +  u  -  f 

^2  “  ^“^^^2  *  ^  ^  (2.32) 

73  “  (“2)y^  +  u  -  f 

and  Laplace  transforming! 
sYi  -  (O)Ij^  -  U  -  F 

SY2  -(-1)Y2  -  U  -  F  (2.33) 

SY3  ^(-2)Y2  -  U  -  F 

The  block  diagram  of  the  equations  (2*33)  is  drawn  in  Figure  2.3. 

The  fact  that  the  variables  have  been  "separated"  can  be  seen  clearly  by 
corapviring  Fig.  2.3  with  the  original  block  diagram  (Fig.  2.1), 

The  systems  to  be  discussed  in  the  remainder  of  this  volume  will 
frequently  be  expressed  in  terms  of  canonic  state  variables. 
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Figtire  2.3 

The  System  of  Figure  2,1  Redrawn  in 
Terms  of  the  Canonic  State  Variables 


‘i 
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2.5  The  Second  Method  of  Idaptmov 

The  Second  (Direct)  Method  0f  liapunov  (SML)  is  theoretically  the 
most  general  available  method  for  stability  analysis  of  nonlinear  sys¬ 
tems.  A  detailed  mathematical  discussion  of  the  SML  is  contained  in  the 
books  by  Malkin  [25]  ,  Zubov  [26]  ,  Hahn  [2?]  and  in  various  papers ,  notably 
those  by  Kalman  and  Bert, ram  [28]  and  La  Salle  [?]»  An  introductory  treat¬ 
ment  of  the  SML  and  some  of  its  engineering  applications  are  contained  in 
[29]  (Boston  Workshop  on  the  SML),  Technical  Report  TR-61-6  of  this  con¬ 
tract  [30]  deals  with  the  engineering  applications  of  Liapunov's  second 
method. 

Three  major  limitations  of  the  SML  in  the  analysis  of  autonomous 
nonlinear  physical  systems  are  presently? 

1,  There  are  no  known  straight-forward  procedures  of  construct¬ 
ing  Liapunov  functions  for  the  general  class  of  nonlinear 
autonomous  systems,,  One^s  success  depends  largely  upon  in¬ 
tuition  and  experience o 

2.  The  known  Liapunov  functions  for  special  types  of  nonlinear 
systems  yield  sufficient  but  not  necessary  conditions  for 
stability o 

3«  The  SML  is,  at  the  present  state  of  the  art,  not  directly 
applicable  to  systems  with  limit  cycles,  no  matter  how  small 
and  insignificant  the  limit  cycle  oscillations  may  be, 

A  survey  of  the  most  widely  applicable  methods  of  constructing  Liapunov 
functions,  including  some  restilts  of  research  at  Purdue,  is  contained  in 
Technical  Report  TR-6I-6  of  this  project  [30] .  Many  autonomous  systems  con- 
raining  nonlinear  gain  elements  can  be  analyzed  successfully  by  the  SML  by 
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means  of  the  canonic  transformations  of  Lur*e  [31]  ,  Letov  [32]  and  the 
pseudo-canonic  transformations  developed  at  Purdue  [35]  •  Attempts  have 
recently  been  reported  to  analyze,  by  the  SML,  the  stability  of  relay 
(switched)  systems  (Alimov,  [33] )  and  systems  with  time  delay  (trans¬ 
portation  lag),  (Razumikin,  [34]). 

The  failure  of  the  SML  to  yield  necessary  condi'ions  for  stability 
is  frequently  the  result  of  its  inability  to  predict  limit  cycle  os¬ 
cillations,  Some  progress  in  extending  the  applicability  of  the  SML 
to  systems  containing  limit  cycles  has  been  reported  by  Zubov  [26]  and 
La  Salle  [7] .  Rekasius  and  Szego  developed  a  procedure  whereby  one  is 
able  to  find  a  closed,  bounded  region  in  the  state  space  in  which  the 
limit  cycle  is  confined,  without  the  need  for  exact  solution  of  the 
limit  cycle  [35] • 

Hence  the  present  day  practical  limitations  in  the  applicability  of 
the  SML  in  stability  analysis  of  autoncxnous  nonlinear  systems  are  gradually 
diminishing.  It  appears  that  continued  research  efforts  will  make  the  SML 
a  very  practical  and  powerful  tool  for  the  stability  analysis  of  autonom¬ 
ous  nonlinear  systems. 
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CHAPTER  3 

STABILITY  OF  NON-AUTONOHOUS  SYSTEMS 


3.1  Introduction 

Despite  the  fact  that  autonomous  and  nonautonomous  systems  have 
been  defined  precisely  in  Chapter  1  of  this  volume,  it  will  be  worth¬ 
while  to  review  quickly  those  definitions  and  discuss  their  applica¬ 
bility  in  this  chapter.  The  term  "autonomous"  refers  to  a  free  (un¬ 
forced)  time  invariant  system  whereas  the  term  "nonautonomous"  refers 
to  a  time  invariant  (stationary)  system  subjected  to  inputs  (forced 
system)  or  to  time  variable  parameter  (nonstationary)  systems  irre¬ 
spective  of  vdiether  they  are  forced  or  not.  In  this  chapter  a 
distinction  between  iinforced  and  forced  will  be  made  instead  of  a 
distinction  between  autonomous  and  nonautonomous  systems. 

It  will  suffice  to  mention  at  this  point  that  the  problem  of 
determining  the  stability  of  a  nonstationary  nonlinear  forced  system 
should  be  relegated  into  the  background auntil  the  problem  of  obtaining 
the  stability  information  of  a  stationary,  nonlinear  forced  system  is 
solved. 

Considerable  effort  has  been  expended  by  various  researchers, 
particularly  by  mathematicians  investigating  the  stability  theory  of 
differential  equations,  to  obtain  methods  of  determining  the  stability 
of  unforced  systems.  In  general,  an  unforced  system  is  a  fiction  which 
does  not  exist  in  practice.  Every  control  system  is  forced,  either  due 
to  inputs  or  disturbances  or  both. 

One  possible  reason  for  the  existence  and  continuirig  increase  of  the 
vast  amount  of  literature  dealing  with  the  stability  of  nonlinear  unforced 
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systems  by  technical  journals  may  be  due  to  the  fact  that  most  engineers 
still  think  of  nonlinear  systems  in  terms  of  analogous  linear  time- 
invariant  systems.  It  is  a  fairly  common  practice  to  try  to  extend 
familiar  concepts  applicable  to  special  cases  to  more  general  cases. 
Unfortunately,  this  method  often  leads  nowhere.  This  is  evidenced^  for 
example,  by  the  tremendous  thou^  essentially  unsuccessful  efforts  that 
have  been  made  to  extend  the  use  of  the  familiar  Laplace  and  Fovurier 
transforms  to  analjrze  linear  •*  ime  variable  parameter  systems  [23]  . 

The  stability  characteristics  of  a  linear  system  are  the  same 
irrespective  of  whether  there  are  any  inputs  to  the  system  or  not.  Hence 
it  is  common  practice  while  studying  the  stability  of  linear  systems  to 
consider  only  the  unforced  case.  There  is  considerable  justification  in 
adopting  this  procedure  since  the  stability  of  both  the  forced  and  un¬ 
forced  systems  are  simultaneously  determined. 

A  practicing  control  engineer  has  very  little  use  for  methods  which 
yield  stability  information  for  unforced  systems  only,  since  every  actual 
control  system  is  governed  by  a  differential  equation  with  a  forcing 
function.  Unfortunately,  most  methods  that  are  available  at  the  present 
to  investigate  the  stability  of  nonlinear  systems  seem  to  be  applicable 
only  to  the  unforced  case.  Even  a  regxxlator  is  not  an  unforced  system 
since,  despite  the  fact  that  the  input  is  a  constant  and  hence  the  devia¬ 
tions  of  the  input  frcm  a  steady  state  value  are  zero,  the  output  and 
load  disturbances  make  the  system  forced. 

The  last  paragraph  should  not  be  interpreted  to  mean  that  the  stability 
of  the  unforced  system  is  unimportant.  It  is  quite  possible,  however,  that 
an  unstable  (in  the  sense  that  limit  cycles  of  undesirable  amplitudes  might 
exist  in  the  system)  unforced  system  may  become  stable  (in  the  sense  that 
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the  Limit  cycle  may  be  reduced  in  amplitude  cr  quenched  altogether)  when 
subjected  to  inputs.  A  special  case  of  this  occurrence  is  the  phenomenon 
of  signal  stabilization,  discussed  later.  However,  it  is  also  quite  Ij'iely 
that  for  some  period  of  time  the  system  may  be  exposed  to  constant  inputs 
or  load  disturbances.  In  this  case  the  system  is  mathematically  equivalent 
to  an  unforced  system.  Hence  it  is  necessary  to  impose  restrictions  on  the 
stability  characteristics  of  the  xmforced  system.  The  ccnmients  in  the  last 
paragraph  apply  to  methods  which  are  useful  for  investigating  unforced 
systems  only  and  not  to  the  xinforced  systems. 

The  nonexistence  of  suitable  methods  for  investigating  the  stability 
of  forced  nonDlnear  systems  is  further  complicated  by  the  very  concept  of 
stability  for  these  systems.  The  familiar  concept  of  stability  which  is 
straightforward  and  intidtively  easy  to  understand  in  the  case  of  linear 
time  invariant  systems  takes  on  a  more  subtle  and  difficult  aspect  in  the 
case  of  nonlinear  autonomous  systems  in  general  and  nonlinear  nonautonomous 
systems  in  particular,  Antosiewicz  |36j  defines  several  distinctly  differ¬ 
ent  types  of  stability  for  nonlinear  systems. 

Considerable  research  is  warranted  before  any  conclusions  may  be  drawn 
regarding  methods  of  investigating  stability  of  forced  nonlinesn*  systems. 

One  general  method  which  is  capable  of  further  extension  and  two  special 
inter-related  methods  useful  for  investigating  the  stability  of  certain 
specific  stationary  nonlinear  forced  systems  are  considered  in  this  section. 
Needless  to  say,  the  philosophy  of  presentation  of  this  section  may  seem 
to  have  overtones  of  pessimism  because  of  the  present  state  of  the  art  of 
nonlinear  systems  in  general  and  nonlinear  forced  systems  in  particvLLar, 
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3  <.2  The  Second  Method  of  Liapunov 

While  the  SML  still  is,  theoretically,  the  most  general  available 
method  for  stability  analysis  of  unforced  nonlinear  systems,  its  practical 
application  is  still  in  its  infancy  despite  the  fact  that  several  special 
techniques  are  available  for  specific  nonlinear  unforced  systems.  To  em¬ 
phasize  the  enormous  difficulties  encountered  in  stability  analysis  of 
txnforced  nonlinear  systems,  it  is  sufficient  to  note  that  even  the  problem 
of  linear  time-varying  systems  still  awaits  its  solution. 

As  pointed  out  earlie^  additional  difficulties  encountered  in  the 
application  of  the  SML  to  forced  systems  are  due  to  a  number  of  distinctly 
different  types  of  stability  which  manifest  themselves  only  in  nonautonom- 
ous  systems.  Consequently  the  theorems  of  the  SML  of  stability  and  in¬ 
stability  take  on  different  forms,  depending  upon  the  type  of  stability 
which  is  to  be  proved.  Many  stability  and  instability  theorems  for  un¬ 
forced  systems,  stationary  and  nonstationary,  based  upon  the  SMI  are 
contained  in  the  books  by  Hahn  [21]  ,  Zubov  [26]  ,  Malkin  [2^  and  in  the 
papers  of  Antosiewicz  [36]  and  Kalman  and  Bertram  [28] •  Very  little  is 
known,  however,  at  the  present  time  of  how  to  construct  Liapunov  functions 
for  nonautoncraous  systems,  A  few  studies  of  stability  of  special  cases  of 
time-varying  parameter  systems  are  scattered  in  the  periodical  literature, 
primarily  in  various  issues  of  Automatika  i  Telemekanika  (Automation  and 
Remote  Control)  and  Prikladnaja  Materaatika  e  Mekanika,  (P.M.M.). 

While  there  is  Httle  hope  yet  for  a  major  breakthrough  in  the  practi¬ 
cal  application  of  the  SML  and  the  methods  of  constmaction  of  Liapunov 
functions  for  the  general  case  of  forced  nonlinear  system,  some  special 
cases  may  in  the  near  future  beccrae  practically  raanagable.  These  are. 
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for  example, the  stability  of  linear  time  varying  systems  (Szego,  [37]), 
and  the  analysis  of  systems  with  periodically  varying  coefficients,  etCo 
Despite  the  fact  that  the  solution  of  this  problem  does  not  solve  the 
problem  of  determining  the  stability  of  nonlinear  forced  systems,  it  is 
hoped  that  it  will  provide  some  insight  into  the  latter  problem,, 

Very  little  is  known  about  the  problem  of  the  stability  of  a  general 
nonlinear  system  subjected  to  inputs  from  the  point  of  view  of  the  SMLo 
However  it  is  sometimes  possible  to  invoke  Massera’s  theorem  [38]  which, 
in  essence,  states  that  a  sufficient  condition  for  the  total  stability 
of  a  forced  nonlinear  system  (stationary  or  nonstationary)  is  that  the  un¬ 
forced  system  be  unifonaly  asymptotically  stable©  Massera's  theorem  is 
still  not  very  usefxil  for  nonstationary  nonlinear  systems  since,  as  pointed 
out  earlier,  the  application  of  the  SML  even  to  nonstationary  linear  sys¬ 
tems  is  not  easy©  However,  Massera’s  theorem  may  have  some  use  in  the  case 
of  a  stationary  nonlinear  system  since  certain  methods  for  applying  the 
3ML  to  certain  special  classes  of  nonlinear  systems  are  available  in  the 
literature©  Notice,  however,  that  the  use  of  Massera’s  theorem  imposes 
severe  resti*ictions  on  the  stability  characteristics  of  the  \inforced  sys¬ 
tem©  Uniform  asymptotic  stability  may  be  a  sufficient  but  not  necessary 
condition  for  acceptance  of  an  engineering  system©  This  condition  ex¬ 
cludes,  for  example, all  systems  which  may  possess  small  limit  cycles  for 
some  specific  values  of  the  system  parameters© 

At  the  present  state  of  the  art  the  SML  for  forced  nonlinear  systems 
is  a  fruitful  area  of  research  but  has  so  far  yielded  very  little  of 
practical  importance© 
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3»3  Siffial  Si^abilization 

The  stability  characteristics  of  a  linear  systeoa  are  unaffected  by 
the  inputs  to  the  system.  This  however  is  not  time,  in  general,  for 
nonlinear  systems.  The  possibility  of  changing  the  stability  character¬ 
istics  with  different  inputs  is  the  property  which  allows  "signal  stabili¬ 
zation". 

Feedback  Control  Systems  in  a  state  of  self  sustained  oscillations 
(limit  cycle  operation)  resulting  in  output  hunt  may  often  be  stabilized 
by  the  introduction  of  an  external  signal  of  a  sufficiently  high  freauency 
at  a  convenient  point  in  the  loop.  This  phenomenon  is  termed  "signal 
stabilization"  by  Oldenburger  [39]  ,  Here  a  system  is  said  to  be  stabilized 
if  the  amplitude  of  the  output  hunt  is  reduced  below  a  certain  prescribed 
value,  A  first  attempt  to  explain  this  phenomenon  when  the  waveform  of 
the  "stabilizing  signal"  is  sinusoidal  is  due  to  Oldenburger  and  liu  [40] . 
The  theory  developed  by  Oldenburger  and  liu  is  quite  different  from  the 
one  advanced  by  Minorsky  [4.1]  ,  viio  treated  the  use  of  a  signal  to  excite  or 
quench  the  hunt  (self  oscillation)  of  a  physical  system  described  by  a 
particular  type  of  second  order  differential  equation,  Oldenburger  and 
Nakada  [4.2J  extend  the  theory  of  signal  stabilization  to  a  rather  general 
class  of  nonlinear  systems  with  a  triangular  waveform  stabilizing  signal. 
Sridhar  and  Oldenburger  [43]  j  [^]  generalize  the  theory  of  signal  stabili¬ 
zation  and  extend  it  to  consider  random  stabilizing  signals.  They  also 
esrtablish  various  criteiia  to  obtain  stability  information  for  a  particxilar 
class  of  nonlinear  systems,  Oldenburger  and  Boyer  [45]  generalize  the 
theory  developed  in  reference  [40]  for  sinusoidal  stabilizing  signals. 

Signal  stabilization  theory  as  developed  in  references  [40]  and  [4^] 
to  [46]  appears  to  hinge  on  the  fact  that  the  frequency  of  eve.ry  component 
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In  ih«  stabilizing  signal  Is  large  compared  to  the  significant  frequencies 
In  the  system.  This  assumption  Is  consistent  with  the  practical  use  of 
signal  stabilization  for  decreasing  the  output  hunt  In  a  self  •oscillating 
system,  since  It  Is  desired  that  neither  the  system  hunt  nor  the  stabiliz¬ 
ing  signal  be  present  to  any  appreciable  degree  at  the  output.  However, 
the  theory  developed  in  reference  [44]  may  easily  be  extended  to  cover  the 
case  when  the  Input  spectrum  has  low  frequency  components. 

Recently  Gibson  and  Srldhar  [4^]  have  proposed  a  new  method  for  con¬ 
sidering  certain  specific  nonlinear  systems  with  sinusoidal  Inputs  without 
putting  any  restrictions  on  the  frequency  of  the  input.  This  method  will 
be  discussed  further  in  the  next  section. 

It  is  felt  that  the  theory  of  signal  stabilization  provides  a  better 
insight  into  the  problem  of  understanding  the  stability  characteristics  of 
a^  particular  class  of  forced  nonlinear  systems.  It  should  be  pointed  out 
that  it  may  be  possible  to  interpret  a  signal  stabilized  nonlinear  system 
as  either  a  forced  or  unforced  ^tem,  depending  on  whether  the  stabiliz¬ 
ing  signal  generator  Is  included  within  the  'Hjlack  box"  representing  the 
nonlinear  system  or  not. 

3.4  The  Dual  Input  Describing  Function 

The  describing  function  (D.P.)  is  a  very  useful  approximation  in  the 
analysis  of  a  certain  class  of  nonlinear  systems.  It  applies  directly  to 
systems  such  as  those  shown  In  Fig.  3.1.  It  Is  based  on  the  method  of 
harmonic  balance  of  Kryloff  and  BogoUuboff  [8]  and,  as  discussed  above, 
was  applied  to  control  systems  by  Ooldfarb  [9]«  Popov  [47]  has  an  in¬ 
teresting  discussion  of  the  method  of  harmonic  balance  Itself  as  It  applies 
to  control  systems.  In  all  of  this  work  the  system  tinder  analysis  is  un- 


Fig.  3.1 

Th«  Type  of  Syetea  for  Which  the  Deacribing 
Function  Method  of  Analysis  is  Applicable. 
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forced.  It  seems  a  direct  step,  however,  to  appl7  the  conventional  D.F. 
to  forced  systems, 

A  number  of  scheme's  have  been  proposed  for  obtaining  the  closed 
loop  frequency  response  of  a  nonlinear  sjrstem,  for  example,  by  direct 
extension  of  the  conventional  D.F.  .  Among  these  methods,  those  of 
Levinson  [15] ,  Thaler  [48]  and  Ogata  [49]  are  well  known.  Hill  [l6]  has 
proposed  an  ingenious  use  of  the  Nichols  chart  which  is  probably  the  most 
convenient  of  all  of  these  techniques.  Kochenburger  [10]  in  his  original 
paper  discussed  the  extension  of  M  peak  to  the  D.F.  plot  and  presumes 
that  one  can  read  off  the  amplitude  of  the  resonant  peak  of  a  sinusoidally 
driven  nonlinear  system  from  the  D.F.  plot  just  as  one  does  fr<xn  the  hy- 
quist  plot  for  a  linear  system.  Prince  [50]  has  proposed  a  modification 
of  the  conventional  D.F.  to  obtain  tb»  closed  loop  response  of  a  perfect 
relay  system.  However  the  Prince  D.F,  does  nou  appear  to  be  of  wide 
applicability, 

I’he  error  in  all  of  the  work  cited  above  lies  in  the  fact  that  the 
conventional  D.F,  analysis  postulates  a  single  sinusoidal  input  to  the 
nonlinear  elements.  Naturally  the  frequency  chosen  will  be  that  of  the 
input  r.  Now  if  the  closed  loop  system  is  (uniformly)  asymptotically 
stable,  then  with  an  input  signal,  this  analysis  is  as  valid  as  the  con¬ 
ventional  D.F.  analysis  of  unforced  systems.  This  is  so  because  in  fact 
there  will  be  the  single  sinusoidal  signal  at  e,  for  which  the  convention¬ 
al  D.F,  analysis  is  designed. 

Suppose,  however,  that  the  control  system  is  not  asymptotically  stable 
in  the  presence  of  the  input  r.  Then  the  conventional  D.F.  is  in  error 
because  there  is  -  longer  a  single  sinusoidal  signal  at  e.  It  is  a  well 
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known  fact  that  in  a  nonlinear  system  asymptotic  stability  or  instability 
of  the  unforced  case  doe  lot  imply  either  stability  or  instabiU-ty  of  the 
forced  system.  Therefore  it  can  be  concluded  that  it  is  improper  to  employ 
conventional  D.F,  for  closed  loop  response  calculations  unless  the  stability 
of  the  driven  system  has  been  established  by  other  means.  This  fact  is 
apparently  not  appreciated  by  a  significant  segment  of  control  engineers, 

A  number  of  dual  input  describing  functions  (DIDF)  nave  been  proposed. 
However,  they  may  be  applied  to  closed  loop  frequency  response  calculations 
only  under  certain  conditions  that  do  not  usually  hold.  West,  Douce  and 
livesly  j^5ij  have  proposed  a  DIDF  that  is  valid  only  if  the  two  sinusoidal 
components  at  the  input  to  the  nonlinearity  are  related  by  an  integer.  This 
DIDF  is  rather  clumsy  to  manipulate,  but  it  can  be  used  to  detect  subharmonic 
response.  It  cannot  be  used  to  examine  the  general  possibility  of  asynchron¬ 
ous  oscillations  induced  by  the  input  in  general,  however,  Oldenburger  and 
boyer  |45j  have  proposed  a  DIDF  that  is  more  converdent  to  manipulate,  but 
that  is  valid  only  if  the  two  sins  waves  at  the  input  to  the  nonlinearity 
are  widely  separated  in  frequency,  Thua  this  approach  is  useless  within 
the  bandpass  of  the  system,  Sridhar  and  Oldenburger  Ref  have 

developed  a  DIDF  in  which  one  of  the  signals  at  e  is  a  stationary,  Gaussian, 
random  function.  It  appears  that  this  fionction  may  be  employed  to  develop 
the  response  of  a  nonlinear  system  to  a  random  input.  This  problem  has  been 
considered  by  Booton  52  ,  but  of  course  the  same  objection  a  previous 
work  with  sine  waves  applies  to  this:  It  completely  ignores  the  stability 
problem.  Gibson  and  Sridhar  have  applied  a  general  DIDF  developed  by 

Sridhar  to  the  problem  of  closed  loop  frequency  response  and  interest¬ 
ing  results  have  been  obtained.  It  is  shown  in  reference  that  stable 
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unforced  systems  my  become  unstable  under  certain  driving  fmictions  and 
that  also  the  converse  is  true. 

It  is  apparent  that  the  DIDF  nnist  be  developed  until  it  is  as  simple 
and  reliable  for  forced  systems  as  the  conventional  DF  is  for  unforced 
systems  if  it  is  to  be  useful  for  the  specification  of  automtic  control 
systems  for  aero  space  vehicles.  With  the  present  rapid  rate  of  research 
progress  in  this  area,  it  is  possible  that  this  vd.ll  occur  vdthin  the 
next  few  years. 

3  ^^5  Conclusions 

It  is  hoped  that  this  chapter  will  throw  some  li^t  onto  the  magni¬ 
tude  of  the  problem  involved  in  considering  the  stability  of  forced  sys¬ 
tems.  Considerable  research  on  the  problem  of  determining  practical  methods 
for  obtaining  the  stability  of  forced  nonlinear  systems  must  be  conducted  be¬ 
fore  any  significent  progress  can  be  reported  in  this  area.  Even  the  dis¬ 
covery  of  some  approximate  methods  for  determining  the  stability  of  certain 
classes  of  forced  nonlinear  systems,  such  as  the  describing  function  method 
for  a  special  class  of  xinforced  nonlinear  systems,  would  be  a  definite 
contribution.  It  does  not  appear  at  the  moment  that  a  unified  method  of 
stability  analysis  applicable  to  all  forced  nonlinear  systems  vd.ll  be  dis¬ 
covered  in  the  foreseeable  future,  if  at  all.  This  last  statement  appears 
to  be  reasonable  in  the  light  of  the  trend  experienced  in  the  field  of  non¬ 
linear  mechanics,  where  a  number  of  special  methods  for  obtaining  stability 
and  other  properties  of  a  small  number  of  special  classes  of  systems  is  avail¬ 
able,  This  same  approach  of  trying  to  obtain  special  methods  for  different 
types  of  forced  nonlinear  control  systems  is  being  adopted  at  the  present. 

Despite  the  fact  that  most  specifications  that  might  eventually  be 
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rocomaended  for  nonlinear  systems  may  involve  the  response  of  the  system 
to  specific  inputs,  it  is  felt  that  the  problem  of  stability  of  the  forced 
system  is  intimately  related  to  its  response  to  inputs.  Thus,  for  example, 
it  is  possible  to  have  a  "stability  specification"  which  states  that  a 
limit  cycle  amplitude  larger  then  a  certain  value  cannot  be  tolerated. 

The  specified  amplitude,  of  course,  will  depend  on  the  applications. 

It  is  felt  that  with  the  present  state  of  the  art,  most  of  the  research 
effort  for  determining  the  stability  of  forced  nonlinear  systems  should  be 
concentrated  on  obtaining  methods  for  determining  this  information  for 
stationary  systems.  It  is  hoped  that  solutions  to  this  problem  will  pave 
the  way  for  better  understanding  of  the  problem  and  eventual  solution  of 
the  stability  of  forced  nonstationary  systems. 
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CHAPTER  IV 

THE  RESPONSE  OF  AUTONCMOUS  SYSTEMS 


4*1  Introduction 

A  possible  approach  to  the  problem  of  specifications  for  nonlinear 
systems  is  the  construction  of  a  mathematical  model  which  is  representa¬ 
tive  of  the  best  system  that  can  be  devised  for  a  given  task.  This  sys¬ 
tem,  which  is  optimum  with  respect  to  certain  specific  reqidrements,  and 
its  performance  can  be  used  as  the  upper  bound  on  physical,  but  not 
necessarily  optimum,  systems. 

The  question  of  which  model  is  optimum  for  a  given  task  must  include, 
in  general,  consideration  of  such  qualities  as  reliability,  econony  and 
performance,  to  quote  three  examples.  In  addition,  one  engineers’  optimum 
may  well  differ  from  another  engineers’  optimum  within  a  given  task* 

The  problem  has  been  formulated  in  the  literature  (Bellman  [54]  >  P*  22), 
(Merriam  [5^  ,  p*  267),  (Lee  [56])  in  terms  of  a  classical  problem  in  the 
calculus  of  variations  (Forsyth  [57],  Chapter  1)*  Here  an  index  of  per¬ 
formance,  j(x,y),  is  to  be  minimized  (or  maximized)  by  choice  of  the 
fvuiction  y: 

J(x,y)  -  J  k(x,  y)dt  (4-1) 

where  the  vector  |jjc}  represents  the  system  state  variables 
the  vector  |^y|  is  the  system  steering  function 
and  the  time  T  is  related  to  the  termination  of  the  control  problem. 

The  function  k  is  chosen  to  include  the  considerations  mentioned  above 
and  the  constraints  of  a  given  problem.  In  practice  the  choice  of  this 
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function  usually  involves  a  compromise  between  an  accurate  evaluation  of 
the  physical  process  and  a  more  tractable  mathematical  problem. 

Solution  for  the  function  y  as  a  function  of  time  then  defines  an 
optimum  policy  for  the  system,  should  such  a  policy  exist,  by  means  of 
which  optimum  performance  is  achieved.  General  problems  of  this  nature 
are  frequently  insolvable. 

The  purpose  of  this  chapter  will  be  to  examine,  therefore,  a  speciali¬ 
zation  within  the  general  problem  which  has  received  attention  in  the  litera¬ 
ture,  The  class  of  system  to  be  considered  are  those  that  are  autonomous 
([l]>  P«  32)  and  where  y  is  to  be  determined  so  that  the  disttirbed  response 
is  time  optimum. 

The  study  of  this  restricted  class  of  systems  together  with  the  re¬ 
stricted  nature  of  the  performance  index  is  warranted  as  it  permits  ex¬ 
ploration  of  the  techniques  useful  with  these  rather  difficult  problems » 

The  chapter  reflects  the  state  of  the  art  and  indicates  that  the  approach 
has  much  promise,  but  that  there  is  the  need  for  further  work  in  this  area, 

4,2  Time  Optimum  Switched  Systems 

Engineers  always  try  to  build  the  best  system  possible  from  every 
point  of  view,  e,g,,  reliability,  economy  and  performance.  Often  one  system 
quality  must  be  sacrificed  for  another,  and  the  resulting  system  is  then  the 
])est  that  can  be  built,  i,e,,  optimum,  after  having  taken  all  factors  into 
consideration,  A  specialization  within  this  optimum  concept  is  the  perform¬ 
ance  specification  of  being  "time  optimum”.  The  question  to  be  answered 
here  is  how  should  a  system  be  built  so  that  it  will  achieve  its  objectives 
in  minimum  time. 


Some  time  ago  engineers  began  to  reason  that  perhaps  the  system  that 


could  U8*  th«  mxiinum  povor  aTallAbl*,  all  of  the  time,  would  be  time 
optimum.  Thie  idea  le  contrary  to  the  concept  of  a  linear  eTstem  where 
the  maxi, mom  power  arailable  is  ueed  only  for  one  instant  of  time  and  a 
leaser  amount  used  at  all  other  times.  The  inttiltlTe  conclusion  at  this 
stage  was  that  a  relay  system  and  a  time  eptianm  system  were  one  and  the 
same  thing. 

A  relay  system  is  a  nonlinear  systesi  with  a  fundamental  property 
that  the  nonlinearity,  the  relay,  is  separable  from  the  linear  portion  of 
the  system.  The  configuration  is  like  that  of  Figure  4*1  »  rather  than 
the  linear  system  shown  in  Figure  4*2. 

E^ly  attempts  to  analyse  such  systems  were  restricted  to  cases  where 
the  linear  portion  of  the  system  had  a  relatlTely  simple  foxm,  frequently 

G(b)  -  ijr  jot  0(s)  -  — — — 
tr  sClvJPs) 

(Bogner  [58]),  (Oldenburger  [59]),  (Weiswander  [60] ),  (Kahn  [6l] ), 

Once  the  relay  has  been  included  in  the  circuit  the  question  arises, 
when  must  it  switch?  If  the  phase  plane  is  used  (this  representation  is 
applicable  to  the  second  order  examples  of  the  paragraph  abore),  where  de 
the  switching  boundaries  lie? 

The  system  shown  in  Figure  4.1  will  switch  along  a  line  that  is  the 
ordinate  axis.  Figure  4.3.  Here  the  objectire  would  be  to  reduce  the  error 
and  the  deriratlye  of  the  error  to  zero.  Variations  of  the  switching 
boundaries  include  linear  switching.  Figure  k»U,  and  parabolic  switching. 
Figure  4.5*  In  each  of  these  three  diagrams  there  are  sereral  possibili¬ 
ties;  for  example,  changing  the  switching  to  a  different  quadrant  of  the 
phase  plane,  or  interchanging  the  relay  polarity. 

With  the  Introduction  of  the  more  ooBq;>lieated  switching  boundary,  an 
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Figxire  4*1  System  with  a  Separable  Nonlinearity 


FigTore  4.2  Linear  System  uifth  Gain  K 
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additional  element  must  be  added  to  the  system.  This  element  will  have 
the  task  of  determining  where  the  system  variables  are  with  respect  to  the 
boundary  and  which  polarity  to  feed  to  the  relay.  The  element  will  be  a 
form  of  computer  and  the  configuration  becomes  that  of  Figure  4.6  for  the 
system  corresponding  to  Figvu*e  4.4  or  4.5. 

None  of  the  systems  mentioned  yet  coiild  be  called  successful,  however, 
except  in  restrictive  cases.  For  example  the  configuration  of  Figure  4.1 
with  the  boundary  of  Figure  4.3  will  switch  many  times  before  a  region 
near  the  origin  is  reached,  and  then  it  will  oscillate  about  the  origin 
(limit  cycle).  With  the  switching  boundary  of  Figui*e  4.4,  the  system  will 
only  reach  the  vicinity  of  the  origin  from  a  discrete  number  of  points  on 
each  side  of  the  boundary.  From  all  other  points  the  system  will  drive 
toward  one  of  two  points  on  the  abcissa,  on  either  side  of  the  origin. 

The  points  will  correspond  to  the  magnitude  of  the  relay  output.  Neither 
of  these  cases  are  time  optimum  nor  are  they  optimum  in  any  sense. 

The  parabolic  boundary  of  Figure  4.5  is  time  optimum  for  the  special- 
ized  system  with  the  linear  portion  described  by  G(s)  =  l/S  .  The  tech¬ 
nique  used  to  deduce  this  boundary  ( [58] ,  p,  117)  is  not  stiitable  for  use 
with  other  systems  as  it  depends  on  the  phase  plane  technique  and  the  re¬ 
stricted  nature  of  the  system  considered. 

The  relay  used  has  so  far  been  considered  ideal.  No  relay  is  ideal 
and  a  number  of  authors  have  attempted  to  extend  the  techniques  used  with 
these  rather  special  systems  and  boimdaries  to  allow  for  physical  relay 
characteristics  such  as  deadband  and  hysteresis  [60] ,  (izawa  [6l]). 

It  is  to  be  noted  that  any  physical  system  must  have  deadband  in  the 
relay  mechanism  in  order  to  deactivate  the  system  when  it  reaches  the  origin. 
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Fi^fure  4.6 

System  Configuration  for  Nonsimple 


Svd-tching  Boundaries 
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Alternatively  the  computing  element  can  be  designed  to  allow  the  system  to 
operate  linearly  in  a  region  near  the  origin.  Tliia  is  the  dual-mode  system 
(McDonald  [63]  ),  (Bulund  [64]),  a  simple  example  of  which  can  be  derived 
from  Figure  4.4  as  shown  in  Figure  4*7*  The  boundary  of  the  linear  region 
of  operation  can  take  a  number  of  forms  and  is  left  undefined  in  Figure 
4.7  for  this  reason.  Some  such  procedure  of  deactivation  or  restricted 
linear  operation  is  necessary  with  all  practical  systems. 

It  was  suggested  at  this  stage  of  the  development  of  optimian  switched 
systems  unat  the  number  of  switchings  needed  for  systems  with  real,  distinct 
roots-  associated  with  the  linear  portion,  is  (n  -  1),  where  n  is  the  sys¬ 
tem  order  (discussion  to  [60]),  [5B]. 

The  next  development  in  the  state  of  the  art  was  the  complete  analysis 
of  a  second  order  system,  again  with  an  ideal  relay.  The  systems  investi¬ 
gated  were  those  that  could  be  described  by  equations  of  the  form: 

do  • 

y  +  2/y  +  y-  +1  (4-2) 

The  investigators  sought  out  every  possible  mode  of  operation-  and  by 
systoraatic  elimination  converged  on  the  optimum  (Flugge  -  Lotz  T65] ), 

(Bushaw  [66]),  (Tsein  [67],  p.  136).  Sufficient  theorems  and  lemmas  were 
proven  to  sizbstantiate  tue  elimination  process  and  the  optimum  was  proven 
optimum.  The  results  reported  by  Bushaw  in  his  Ph.D.  thesis  [66]  and  re¬ 
produced  by  Tsein  [67]  show,  for  example,  that  for  the  case  where  ^  »  0 
in  equation  (4.1)  the  switching  bounderlos  for  optimum  time  response  are 
portions  of  the  circles  associated  with  the  system  singular  points  in  the 
phase  plane,  centers  in  this  cast^  as  in  Figure  4*B. 

It  is  fairly  obvious  that  the  tool  wfiereby  the  results  obtained  so  far 
had  been  obtained  is  the  phase  plane  method  and  the  geometrical  interpreta- 
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Switching  Botindaries  for  a 
Second  Ox'der  System  with  Zero  Damping 
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tion  po«aibl*  th«r9.*  ^hird  »rd*r  sy3t«ai  analysis  has  b««n  attwaptad  on 
tha  phasfl  plana,  or  rathar  on  two  phaaa  planas  [.54] ,  (Chang  [68]) «  Tha 
laathod  is,  howarar,  /athar  cnwbarsooMi  and  for  practical  purposas  tha  phasa 
plana  is  rastrictad  to  sacond  order  sjrstaios^  This  lijaitation  has  lad  to 
tha  usa  of  a  stata  space  and  state  trariablas  (described  alsawhera  in  this 
volupa)  and  tha  usa  of  more  elegant  mathaiuatics* 

Consider  tha  configuration  shown  in  Figure  4*9  which  is  tha  forward 
transfer  function  of  tha  systaia  to  be  axaminad*  Tha  nonlinaarity  is  not 
defined,  as  it  is  the  rariabla  to  be  used  in  the  time  optimization  process. 
It  is,  however,  constrained  to  be  a  real,  maasurabla  function  of  the  input 
variable  m  and  bounded  above  and  below  such  that  -1<  |iii(t)|  ^  1.  Tha  form 
af  tha  linear  portion  of  tha  systaa  is  not  necessarily  constrained  to  tha 
form  shown  in  Figure  4 •9*  Tha  farm  can  vary  considarablj-  with  tha  only  re¬ 
striction  that  tha  system  aquations  can  be  written  in  matrix  notation  and 
in  canonical  form  as  described  alsaidiara  in  this  volxaaa  (Chapter  2). 

Tha  system  aquations  of  this  example  are: 


# 

010 

1— 

0 

- 

0 

^  - 

001 

... 

0 

>  u  +  •< 

0> 

# 

V  J 

0  -2  -3 

^3 

1 

f 

-  J 

ar>  ([20]  ,  aquation  1) 

Transforming  from  tha  physical  variables  to  tha  stata  variables  -j^j^with 
the  transformation,  is: 

W  -  [H]{x} 


(4-5) 
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Figure  4.9 

Forward  Transfer  Function  of  a  System 
with  a  Separable  but  Undefined  Nonlinearity 


52  o 


(4-8) 


wher«  th*  matrix  [h]  is  giran  by  a  salution  of  tha  matrix  aquation? 

[h]  -  [a][h]  with  initial  conditions  [h(0)]  -  [l]  .  (4-6) 

Tha  matrix  [h]  is  dafinad  as  tha  systam  inpolsa  rasponsa  matrix  in 
tarms  of  tha  Tariablas  (x|^.**Xj^)  and  may  also  ba  determinad  as? 

[h]  -  a^  (4-7) 

wlfara  [a]  is  tha  systam  matrix. 

Tha  solution  to  aquation  (4-4)  »*y  now  ba  datanninad  by  Lagrangas 
mathod  of  rariation  of  paramatars  (  [2l]  »  chaptar  10^  saction  12).  lUffar- 
ant dating  (4-5)  and  substituting  in  (4-4)* 

[;}  -  [H]{r}  .  [H]{;} 

f;}  -  [A][H]S  .  [B]{u}  .  (f) 

Comparing  thasa  two  aquations  with  tha  halp  of  (4-6)  ona  gats? 

[H]f;}  .  {r}  (4-9) 

Intagrating],  ratuming  to  tha  original  variablas  and  using  tha  initial 
condition  vactor  is  found  to  bo? 

{x(t)}  -  [h]{i(o)}  t  [h]/  [k]  [b][^  dt  *  [h]/[h]  \f}  dr  (4-10) 

o  a 

This  i;s  tha  solution  of  tha  systam  aquations  and  can  ba  foxmd  proTidad 
aquation  (4-6)  can  ba  solrad  and  the  integrations  can  ba  carriad  out.  Tha 
solution  of  aquation  (4-6)  is  xmfortunataly  a  difficult  if  not  impossibla 
task  in  the  general  case.  Whether  or  not  thasa  integrations  can  ba  par~ 
formed  depends  largely  on  tbo  farm  of  ■^u(t^.  Tha  restrictions  already 
placed  upon  tha  nonlinearity  wiU,  howararj,  ustially  make  tha  operation 
possible. 


-  53  - 


When  thf  system  under  consideration  is  autonomous  i 


fx(t)] 


•e.  |^f(r)j=  0 


to  the  null  vector. 


the  problem  becomes  that  of  reducing  the  vector 
Equivalently  the  system  must  "hit"  the  origin  of  the  state  space.  Fran 
equation  (4-10)  it  can  be  seen  that  this  situation  will  have  been  achieved 
Trtien: 


.(x(0)]  ./Vl  (^)][u(t)}dr  (4-u) 

A  number  of  things  must  now  be  proven.  For  example  it  must  be  shown  that 

there  exists  a  t^  0  for  which  the  equation  (4-11)  is  satisfied  for  any  u(t). 

Then  it  must  be  demonstrated  that  of  all  the  different  values  of  t^  that  will 

o 

satisfy  this  equation  one  of  them,  t*,  will  be  minimized  by  a  suitable  choice 
of  u(t).  Finally  the  form  of  u(t)  must  be  determined. 

The  various  points  to  be  proven  have  been  examined  rigorously  in  the 
literature  [20j,  (Bellman  jTb?] ),  (Kurzweil  jvoj )  and  the  proofs,  which  are 
reasonably  lengthy  and  difficult,  will  not  be  reproduced  here.  The  proofs 
indicate,  however,  that  a  vector  must  be  found  such  that  the  "dot" 
product  below  is  maximized. 

f?)  •  (4-12) 

This  is  the  same  as  maximizing: 


(4-13) 


It  is  shown  in  the  literature  referenced  above  that  this  maximum  exists 
and  will  be  achieved  when: 

[uj  «  sgn  (4-14) 

i.e.  ju^l  -  1 

The  procedure  described  above  can  be  demonstrated  by  means  of  the  following 
example. 
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Consldtr  th*  cas«  of  a  linoar  oacillator  \id.th  tho  circuit  configura~ 
tion  shown  in  Figuro  4 •10.  This  particular  ejaunplo  ie  choson  as  it  is  ono 
’difcuasod  by  Bushaw  ( [66] ,  p.  42) «  His  dotailod  discussion  loads  to  tho 
corroct  switching  boundarios  (rof  [l^,  p*42)  but  with  rathor  moro  of fort 
than  is  roquirod  using  tho  oMthod  doscribod  abovo. 

Tho  system  equations  in  matrix  form  are: 


and  it  is  known  that  for  tins  optimui  response  tho  function  u  can  take  on 
the  raluos  of  +1  or  -1,  '"n  order  to  obtain  tho  matrix  solution  tho  method 
of  Lagrango  can  host  bo  applied  hero.  Tho  solution  to  tho  matrix  oquation 
bolew  must  bo  found  first: 


[5]  -  [a]  [h]  with  [h(0)]  -  [l] 

idiich  in  this  caso  bocomos: 


(4-16) 
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This  matrix  oquation  yiolds  four  socond  order  differential  equations  which 
can  bo  solrod  with  tho  initial  conditions  to  giro: 

*  cost,  “  sint  ■  -oint  and  H^g  •  cost 
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and  "  "Vi  (4-20) 

which  can  also  bo  wrlttoni 

[7}'H  ■  ■*■  ^)  A  “‘‘I  ^  “*•  ftmctlons  of  ^  <j^2  (4-21) 

So  It  is  soon  that: 

u  ■  ‘^1  whon  Acos(t  •»  d)  >  0 

and  u  •  -1  whoa  Aeos(t  d)  >  0  (4-22) 

and  It  Is  laBsdiatoly  apparont  that  tho  roloj  ansi  swltclt  ororjr  7?  soeonds* 
lx  tho  systea  is  to  roach  tho  origin  of  tho  stato  spaeo  the  final  solu¬ 
tion  trajectory  aust  go  through  tho  origin*  There  will  bo  two  such  final 
trajoetorlos^  one  for  each  of  tho  two  easos,  u  ■  4-1  and  u  ■  -1*  I^irthor- 
aorOf  since  those  trajectories  are  final  traJoctorleSf  tho  systoa  aust 
"switch  onto"  thoa  sooner  or  later  and  they  are  therefore  part  of  the  sys¬ 
tem  switching  boundary* 

To  find  tho  final  trajectories  a  technique  suggested  by  La  Salle  [^2(^ 
and  others  can  be  used*  Let  T  ■  -t  In  the  systesi  equations^  equation  (4-15) « 
and  solre  the  equations  with  the  initial  conditions  (0,0),  l*e*  lot  tijos 
run  backwards  away  froa  the  final  point,  the  origin*  Allowing  tine  to  run 
backwards  for  7^  seconds  will  generate  that  portion  of  the  switching  bound¬ 
ary  through  the  origin*  With  this  substitution  equation  (4-15)  beccaes  In 
coiaponent  fom: 


dT  ^ 

dxj 

When  u  -  4-1  wo  get 

3Cj^(T)  -  1  -  COST 

2  2 

X2(T)  -  -  sinT  or  elininating  T  (xj^  -l)  *  -  1 


(4-23) 


(4-24) 
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When  u  -  -1  we  get 

xi(T)  -  -1  +  COST 

X2(T)  -  slnT  er  aliadnatlag  I  (^  ♦  1)^  ♦  -  1  (4-25) 

Considering  the  signs  In  the  psraBstrle  eqaatlons  and  allowing  T  to  increase 
to  77  seconds f  two  seal-olrcles  result  as  shown  in  Figure  4-11*  The  direction 
of  increasing  t  or  decreasing  T  is  toward  the  mriglB*  Choosing  an  arbitrary 
final  switching  point  on  this  portion  of  the  boundary^  say  at  (1«  -1)  for 
conveniency,  the  solution  trajectory  isssediately  prior  to  this  final  switch¬ 
ing  can  be  determined  from  the  equations  (4-23)  with  initial  conditions 
(1,  -1)  and  with  u  ■  -1.  The  result  ist 

3C;j^(T)  ■  -1  +  2  COST  +  Sin  T 

X2(T)  ■  2sinT  -  COST  or  eliminating  T  (xj^  ♦  1)^  ♦  ■  5  (4-26) 

This  trajectory  is  drawn  in  dotted  lines  on  Figure  4*11*  The  parametric 
equations  again  indicate  the  direction  of  increasing  t  (decreasing  T),  thus 
showing  that  the  portion  of  the  state  plane  abore  the  switching  boundary 
found  so  far  corresponds  to  u  -  -1,  and  the  portion  below  to  u  •  +1,  Allow¬ 
ing  time  to  run  backwaards  along  the  dotted  trajectory  for  ^  seconds  deter¬ 
mines  one  point  on  the  switching  boundary  to  the  left  of  the  existing  portion. 
This  point  is  labeled  B  in  Figure  4«11*  Constructing  trajectories  from 
different  initial  points  on  the  known  portions  of  the  switching  boundaries 
thus  will  3rield  additional  portions  of  the  boundary.  The  coeqalete  picture 
is  clearly  exactly  that  of  Figure  4.6.  It  is  to  be  obserred  that  the  compon¬ 
ents  of  the  maximizing  rector  do  not  hare  to  be  found  explicitly,  but 
rather  the  possible  beharior  of  Equation  (4-14)  is  obserred  and  the  position 
of  the  boimdaries  is  deduced  from  the  zero  crossings  of  • 
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Figure  4*11 

Constimction  of  Switching  Boundariee 
for  linear  Oscillator  Circuit 
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The  method  outlined  in  this  section  is  a  method  that  will  lead  to 
switching  boundaries  which  thus  defines  a  time  optimum  policy  from  any 
admissable  starting  point  in  the  phase  space.  The  method  does  allow  for 
solution  of  systems  where  the  linear  portion  is  described  by  a  linear  time 
varying  equation  »  The  solution  is  only  possible  then  in  the  restricted 
cases  when  equation  (4-6)  can  be  solved. 

The  boundaries  of  the  example  system  and  of  any  more  complicated  sys¬ 
tem  must  be  instrumented  in  the  phase  space.  The  position  of  the  system 
with  respect  to  these  boundaries  must  be  determined  continuously  in  order 
that  the  relay  can  be  switched  to  the  correct  polarity.  There  is  also  the 
additional  problem,  that  frequently  not  all  the  physical  variables  are 
available  frcm  which  the  state  variables  must  be  calculated.  In  this 
situation  a  prediction  or  estimation  of  the  missing  variables  must  be 
attempted  (Kalman  [7l]  ). 

The  sequential  procedure  of  boundary  determination,  boundary  instru¬ 
mentation,  and  the  determination  of  system  position  via  measurement  or 
estimation  is  a  ccanplicated  task  even  for  simple  systems.  In  addition, 
pre-determination  of  the  optimum  policy  does  not  allor  for  unpredicted 
changes  or  disturbances.  The  concept  of  a  multistage  decision  process 
(dynamic  programming)  (Be.llman  [72])  suggests  that  the  nectssary  steps 
mentioned  above  should  be  laidertaken  repetitively  by  onv  conrpd&ing  element. 
The  system  optimum  policy  would  then  be  considered  as  the  solution  of  a  syn¬ 
thesis  problem  that  can  be  reviewed  from  moment  to  moment  as  the  solution 
proceeds.  These  latter  ideas  are  discussed  in  more  detail  in  the  next 


section 
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4«3  The  SyTithesis  Problem 

A  basic  problem  associated  with  switched  systems  is  that  of  determining 
the  switching  boundaries*  These  are  the  hyper-surfaces  located  in  the  sys¬ 
tem  state  space  where  the  system  steering  function  must  change  sign  in  order 
to  adhere  to  the  optimum  policy. 

The  technique  outlined  and  referenced  in  the  last  section  will  solve  the 
problem  of  finding  the  form  of  the  steering  function  u  as  a  function  of  time. 
In  the  case  of  autonomous  systems  and  for  time  optimum  response  it  is  shown 
that: 

u  -  sgn  (4-27) 

where  the  matrix  [y]  is  time  dependent.  In  order  that  the  system  shall 
satisfy  this  relation  it  is  necessary,  therefore,  to  determine  the  points  in 
the  state  space  trtsere  the  sign  of  the  function  changes.  To  find  the  hyper- 
surfaces  made  up  of  all  such  points,  the  form  of  the  steering  function^,,  al¬ 
ready  known  as  a  function  of  time,  must  be  determined  as  a  function  of  the 
state  variables.  It  is  sometimes  written  that,  the  zero  crossings  of  u,  as 
a  fimctiou  of  time,  must  be  mapped  into  the  state  space.  This  is  the  desired 
situation,  as  it  is  assumed  that  the  state  variables  can  be  constructed  one 
way  or  another  [7l]  and  hence  are  available  to  feed  the  computing  elements  of 
Figures  4.6  and  4.10,  The  determination  of  the  switching  hyper-surfaces  ac 
functions  of  the  state  variables  will  be  defined  as  the  synthesis  problem 
and  this  part  of  the  theory  of  optimum  systems  is  considered  as  a  problem 
separate  from  the  problem  of  determining  the  for*  of  the  function  u  as  a 
function  of  time. 

If  the  optimum  policy  can  be  determined  with  certainty  ahead  of  time, 
as  was  the  case  with  the  simple  example  concluding  the  last  section,  the 
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computing  element  may  construct  and  then  monitor  the  ssrsteu  state  rariables* 
The  computing  element  vdll  decide  vfhere  the  system  solution  is  in  the  state 
space  with  respect  to  the  switching  boundaries,  and  make  a  simple  decision 
as  to  the  optimum  relay  position  as  the  solution  proceeds. 

Instrumentation  in  these  cases  is  possible  in  a  number  of  ways,  e.g# 
two  variables  can  be  applied,  one  to  each  of  the  deflection  plates  of  a 
calibrated  oscilloscope.  The  tube  face  is  then  masked  to  match  a  switching 
boundary  and  monitored  by  a  photo-electric  cell  (Hopkin[73]  ).  Techniques 
suitable  in  these  cases  can  be  canpared  with  the  technique  of  pre-program- 
Edng. 

A  more  powerful  approach  to  the  proolem  exists,  however,  that  can  be 
used  to  take  care  of  the  sittiation  when  the  optimum  policy  is  known  initially. 
The  approach  will  also  take  care  of  sittiations  when  the  optimum  policy  nay 
well  change  as  the  solution  proceeds.  The  approach  is  that  known  as  dynamic 
programming  [72] . 

The  title  dynamic  programming  is  a  phrase  coined  to  describe  the  pro¬ 
cedures  associated  with  the  solution  of  a  multi-stage  decision  process.  The 
procedure  involves  sampling  the  system  position  in  the  state  space  repeti- 
ively.  At  each  sampling  the  computer  makes  a  decision  as  to  what  the  optimum 
policy  is  at  that  time.  For  example,  there  are  two  choices  available  in  the 
case  of  a  time  optimum  system  with  a  single  relay.  The  optimum  policy  de¬ 
cided  at  one  sampling  time  is  pursued  until  the  process  is  repeated  at  the 
next  sampling  time. 

Optimum  systems  defined  in  terms  of  their  performance  indicies  that  are 
to  be  treated  in  this  fashion  must  possess  the  basic  property  of  being  Marko¬ 
vian  ^  i.e.,  after  any  niomber  of  decisions,  say  k,  the  effect  of  the  remaining 
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N-k  stages  of  the  decision  process  upon  the  total  return  must  depend  only 
upon  the  state  of  the  systwn  at  the  end  of  the  k-th  decision  and  the  subse¬ 
quent  decisions  ( [54]  >  p«  54)*  Systems  that  are  Markorian  in  nature  will 
then  perform  in  a  manner  that  is  optimum  orerall,  even  when  the  decisions 
ore  made  repetitively  as  the  solution  proceeds.  The  Markovian  property  is 
fortunately  characteristic  of  most  systems  encovuitered. 

It  is  to  be  observed  that  the  past  history  of  the  system  need  not  be 
considered  in  determining  the  future  policy,  and  consequently  such  a  proced- 
^^re  will  allow  for  unpredicted  disturbances,  etc. 

Instrumentation  of  the  computer  element  is  clearly  no  longer  possible 
by  simple  means.  In  fact  the  suggested  procedure  has  only  become  feasible 
with  the  advent  of  high  speed  digital  computers  which  inevitably  perform 
the  computing  task.  There  is  still  a  finite  computing  time  associated  with 
the  decision  process,  of  course,  and  that  places  a  limitation  on  the  sampling 
frequency  and  in  turn  on  the  system  performance. 

An  example  of  a  method  "Jdiere  the  optimum  policy  is  reviewed  as  the  solu¬ 
tion  proceeds  has  been  presented  recently  by  Smith  [74]  and  the  technique 
will  be  stnanarized  here. 

Equation  (4-10),  the  solution  equation  for  the  state  variables,  is  re¬ 
produced  here  but  with  f(r)  »  Or 

t 

(x  (t))  -[h][x(0)}  +  [h  (t^/  [h{T)]  ^[B(r  jl  [u(X)}  dV  (4-28) 

o 

Allowing  that  in  a  time  optimum  problem  the  function  u  can  only  take  on  the 
values  plus  or  minus  one  and  that  this  function  will  change  sign  accor-ding  to 
equation  (4-27)  at  times  tj^,  where  0<t-]_  <T,  equation  (4-28) 


can  be  written: 
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(4-29) 


I.f  the  set  of  n  equations  represented  by  the  matrix  notation  are  integrated, 
the  result  will  be  n  simultaneous,  algebraic  equations  with  the  times 
t2^..oo.<.T  as  unknowns.  The  solution  of  simui.taneous  equations  on  a  digital 
computer  is  possible  by  means  of  well  known  techniques.  Consequently  two 
values  of  T,  say  T'*'  and  T"  corresponding  to  the  choice  of  sign  outside  the 
bracket  on  the  right  hand  side  of  Equation  (4-29),  can  be  calculated  with 
knowledge  of  the  initial  conditions.  The  computer  can  now  make  a  decision 
whether  T^>  T”*  or  T“>  T^^,  and  can  use  the  result  of  this  decision  to 
activate  the  relay  in  the  appropriate  direction.  This  procedure  can  be 
repeated  continuously  by  sampling  the  system  at  intervals  to  obtain  new 
initial  conditions,  i.e,  the  values  of  the  state  variables  at  the  time  of 
sampling.  The  sampling  frequency  can  be  made  as  small  (or  as  large)  as  is 
desired,  weighting  the  computing  time  against  the  system  response  time, 

A  number  of  other  authors  working  with  different  forms  of  integral 
type  performance  indicies  have  sketched  methods  for  the  crtitinuous  solution 
of  the  synthesis  problem.  For  example  Lee  [56]  indicates  possible  methods 
for  the  continuous  solution  of  minimum-energy,  miniinum-time  and  minimum- 
error  systems. 

The  results  that  are  given  by  the  authors  indicate  that  the  desired 
response  is  possible  with  the  techniques  suggested.  It  is  to  be  observed 
that  the  performance  is  obtained  at  some  expense  for  the  amplifier  of  the 
conventional  system  is  replaced  by  a  relay  and  a  digitial  computer 1 1  This 


-  64  - 


fact  is  not,  however,  of  direct  concern  if  the  objective  in  reviewing  these 
methods  is  to  determine  the  best  possible  system,  for  purposes  of  system 
evaluation.  The  physical  construction  of  an  optimum  system  is  a  separate 
problem  which  has  been  solved  by  one  author,  as  described  in  tliis  section. 

4.4  Conclusions 

The  methods  outlined  in  these  sections  depend  to  a  large  extent  on  the 
form  of  the  system  and  on  the  form  of  the  optimum  response  desired.  The 
time  optimum  systems  are  those  where  the  steering  function  is  chosen  to 
minimize  the  upper  limit  of  the  integral  in  equation  (4-1).  At  the  present 
state  of  the  ai*t  much  attention  has  been  given  to  the  time  optimum  problem. 

The  solutions  that  do  exist,  however,  are  restricted  almost  entirely  to 
systems  of  second  order.  The  exception  discussed  in  the  last  section  used 
the  full  capacity  of  a  large  digital  computer  to  handle  a  fourth  order  sys¬ 
tem.  It  is  thus  clear  that  for  systems  other  than  the  simplest  systems  the 
existing  methods  are  far  from  economic  and  cannot  be  considered  as  practical 
as  yet. 

The  concept  of  using  an  optimum  system  as  the  upper  bovind  on  all  systems 
that  are  to  fulfill  a  given  task  is  not  restricted  to  the  time  optimum  caseo 
For  exan5)le  other  optimum  systems  require  that  u  be  chosen  with  a  fixed  upper 
limit  on  the  inte^al  to  ndniMze  (or  maximize)  the  integral  itself.  Alter¬ 
native  methods  that  may  lead  to  the  solution  of  these  problems  must  be  sought. 

It  has  been  shown  (Rozonoer  )  that  all  problems  of  this  nature  can 
be  interpreted  as  a  problem  of  maximizing  (or  minimizing)  a  coordinate  in  the 
state  space,  together  with  sane  constraints.  For  example  if  there  is  a  sys¬ 
tem  described  by  n  equations  as  written  in  equation  (4-4)  and  the  optimum 
system  is  defined  as  a  time  optimum  system  with  the  additional  constraint: 
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The  system  equations  can  now  be  re-written  in  the  form  of  equation  (4-4)  but 
with  n  +  2  variables* 


The  requirement  for  the  syutem  to  be  optimum  is  now  that  the  coordinate 
is  to  be  minimized  with  the  constraint  that  the  coordinate  ^+2^^)  ^ 
;.'stems  of  this  type,  where  a  coordinate  or  a  linear  combination  of 
coordinates  must  take  on  an  extreme  value,  can  be  optimized  by  the  Principle 
of  Pontryagin  |7^  (with  a  unified  procedure).  While  the  Maximum  Principle 
of  Pontryagin  is  in  the  haivis  of  the  applied  mathematicians,  at  the  present 
state  of  the  art,  it  is  to  be  hoped  that,  with  attention  from  qualified 
engineers,  it  will  be  proven  to  be  of  great  practical  value  in  the  design 
of  optimum  automatic  control  systems. 

In  conclusion,  it  is  remarked  that  the  methods  for  the  determination 
and  construction  of  the  configuration  necessary  for  an  optimum  system  of 
ar^y  sort  are  as  yet  in  their  infancy  for  anything  but  the  simplest  systems. 
The  methods  reported  in  this  chapter,  however,  indicate  that  in  many  cases 
unique  optimum  configurations  exist  in  the  mathematical  sense  of  the  word. 
The  techniques  associated  with  the  method  of  dynamic  programming  and/or 
the  Maximum  Principle  of  Pontryagin  seem  to  provide  the  paths  along  which 
practical  solutions  will  be  found.  This  is  an  area  in  which  there  is  a 
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considerable  interest  from  the  engineering  world  at  the  present  tinieo 
Further  work  will  undobtedJy  prove  to  be  of  considerable  value  for  the 
better  evaluation  and  construction  of  autcnatic  control  systems. 


67  - 


CHAPTHi  V 

THE  RESPONSE  OF  FORCED  NONLINEAR  SISTE«S 

5  »1  Introduction 

While  the  stability  and  response  of  autonomous  nonlinear  systems  is 
of  considerable  interest  to  the  automatic  control  specialist  and  to  a 
number  of  applied  mathematicians  throu^out  the  world  simply  for  the  sake 
of  the  problem,  the  user  of  a  control  system  could  hardly  be  less  interest¬ 
ed*  The  unforced  system  is  of  no  conceivable  engineering  use.  For  a 
system  to  be  of  engineering  interest  it  must  function  properly  over  a 
specified  range  of  inputs. 

This  report  has  considered  the  xinforced  system,  not  because  of  any 
misapprehension  that  such  systems  are  of  any  practical  use,  but  rather 
because  such  studies  should  lead  to  a  b  'itter  xmderstanding  of  the  forced 
system.  It  is  hoped  that  the  techniques  used  for  forced  systems  nay  be 
extended  to  the  analysis  of  unforced  systems.  Such  extensions  are  not 
easy  of  course.  Let  us  cite  two  examples  of  different  kinds  of  problems 
that  arise.  First,  it  has  been  shown  above  that  the  phase  plane  analysis 
may  be  extended  to  an  approximate  analysis  of  a  forced  time-invariant 
second  order  system.  In  this  example  the  only  difficulty  arises  from  the 
approximation  required  of  the  input  and  the  increased  labor  required  to 
obtain  the  result.  A  second  example  however,  will  bring  out  a  more  basic 
difficulty.  In  the  discussion  above  on  the  DIDF  it  has  been  shewn  that 
the  use  of  the  conventional  DF  for  obtaining  closed  loop  frequency  response 
is  fraught  with  danger.  Examples  can  be  given  in  which  the  conventional 
DF  yields  an  apparently  perfectly  satisfactory  closed  loop  frequency  re- 
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sponse  for  a  system  that  is  actxially  tinstable.  This  is  the  second  class  of 
problem.  Not  merely  is  the  method  of  analysis  slightly  more  cumbersome  in 
forced  systems,  but  rather  it  yields  an  incorrect  answer. 

Turn  now  to  the  problem  of  direct  concernj  the  forced  nonlinear  system. 
This  research  is  concerned  with  the  development  of  specifications  for  con¬ 
trol  systems.  Clearly  the  AF  is  not  interested  in  the  detailed  nonlineari¬ 
ties  involved  in  a  particular  system.  The  AF  is  interested  in  performance, 
and  the  partic\ilar  techniques  involved  in  meeting  the  specifications  must 
remain  in  the  design  province.  Thus  it  would  seem  improper  for  this  group 
to  beccane  involved  in  compiling  a  list  of  all  possible  nonlinearities  and 
specifications  for  them  unless  this  were  the  sole  method  open.  The  approach 
that  appears  of  most  validity  would  seem  to  be  the  establishment  of  the 
optimum  performance  within  the  given  set  of  constraints  for  a  given  situa¬ 
tion.  This  theoretical  optimum  may  then  be  used  as  an  Index  of  Performance 
with  which  to  Judge  the  performance  of  competing  physical  systems. 

It  must  be  asked  i«diy  this  approach  is  suggested  when  it  obviously  fail¬ 
ed  with  linear  systems.  Considerable  effort  was  extended  in  attempts  to  ob¬ 
tain  general  Indices  of  Performance  for  linear  systems.  It  will  be  recalled 
that  such  IP*s  were  sou^t  in  terms  of  system  parameters.  In  this  new  effort 
the  IP  will  be  formulated  in  terms  of  the  constraints  'on  the  system.  Such 
constraints  might  be  maximum  force  or  torque,  maximum  power  or  a  finite 
stored  energy  with  which  to  accomplish  the  task.  In  effect  these  are  the 
basic  and  fundamental  nonlinearities  of  the  system,  and  meaningful  maximum 
performance  values  can  be  formulated  within  them.  Such  constraints  do  not 
exist  in  linear  systems,  of  course,  and  so  it  was  impossible  to  formulate 
such  a  policy  concerning  them  in  the  linear  portion  of  this  study.  Since 
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phjslcal  constraints  exist  uniTersallj  In  practice,  this  new  approach  should 
be  of  wide  applicablUtjr. 

To  establish  the  optlnum  sjetea  within  a  giren  set  of  constraints  it  is 
necessary  to  define  the  sense  in  which  the  word  optiam  is  used*  Most  of  the 
work  done  to  date  on  the  optiaum  problea  concerns  the  tiae  optiaua  case.*  The 
desired  task  is  to  reduce  the  error  to  sero  in  iHnina  tiae*  This  is  a  reson- 
able  approach,  although  perhaps  not  the  siaplest,  and  is  discussed  in  Section 
5*3*  In  Section  5*2  the  conrentional  phase  plane  analysis  is  extended  to  the 
approximate  calculation  of  the  response  to  an  arbitrary  input.  Of  course  the 
practical  limitation  of  the  phase  plane  to  second  order  sjrsteas  sererelj 
limits  the  usefulness  of  this  approach*  It  was  not  thought  necessary  to  in¬ 
clude  a  separate  section  in  this  chapter  for  the  DIDP.  This  technique  is 
definitely  of  use  la  finding  the  response  of  a  nonlinear  system  to  a  sinu¬ 
soidal  input,  but  the  method  has  already  been  discussed  in  the  chapter  on 
the  stability  of  forced  systems* 

In  Section  5*4  the  response  of  a  nonlinear  system  to  random  noise  is 
discussed*  At  first  glance  this  mLgjnt  seem  to  be  a  digrosslon  from  the  main  ' 
stream  of  this  survey*  It  must  be  pointed  out  that  this  is  not  so* 

Unfortunately  the  carry-over  of  linear  system  concepts  and  points  of 
view  in  the  thinking  of  many  investigators  when  they  turn  to  nonlinear  sys¬ 
tems  seems  doomed  to  failure.  This  persistence  would  appear  to  be  the  only 
logical  answer,  for  example,  in  the  continued  and  unwarranted  attention 
paid  to  the  response  of  a  nonlinear  system  to  a  sinusoidal  driving  function. 
The  sine  wave  no  longer  reigns  supreme  in  nonlinear  system  analysis;  it  is 
reduced  to  Just  another  special  input  that  provides  no  special  insight  to  the 
overall  beha'*'ior  of  the  nonlinear  system. 
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Wiener  has  proposed  that  the  basic  and  most  general  input  for  a  non¬ 
linear  system  is  the  random  signal  provided  by  Brownian  motion.  He  points 
out  that  frcitt  the  response  of  a  nonlinear  system  to  Brownian  motion,  it  is 
possible  to  predict  its  response  to  any  input;  much  as  it  was  possible  with 
the  response  to  sine  waves  in  linear  systems.  Thus  Brownian  motion  input 
occupies  the  same  position  with  respect  to  nonlinear  systems  as  does  the 
sinusoidal  input  to  linear  systems.  This  concept  appears  very  powerful, 
4,lthou^  it  is  not  yet  in  an  operational  condition,  and  it  is  discussed  in 
Section  5*4. 

5.2  The  Phase  Plane  for  Forced  Systems 

The  phase  plane  can  be  used  to  calculate  and  display  the  response  of 
forced  second  order  systems  (Gibson  \l'f\  ).  The  approach  is,  of  course,  not 
as  simple  as  with  autonomoiw  systems  but  is  still  quite  practical.  The  in¬ 
put  may  be  arbitrary  and  the  approach  makes  use  of  all  of  the  convenience  of 
construction  methods,  such  as  the  delta  method  and  isocline  method,  that  are 
available  for  autonomous  systems. 

The  method  is  based  on  representing  the  actual  input  by  a  train  of 
equivalent  impulse  functions.  It  is  also  necessary  to  represent  the  system 
nonlinearity  in  an  equivalent  piecewise  linear  fashion.  Each  impulse  is 
considered  as  an  initial  condition  for  the  interval  between  it  and  the  next 
piilse,  superimposed  on  the  final  condition  of  the  system  at  the  end  of  the 
preceeding  interval.  The  central  convenience  of  this  approach  lies  in  the 
fact,  as  pointed  out  by  Trlnmer  [78]  ,  that  in  a  second  order  system  an 
impulse  appears  simply  .as  a  sudden  increment  of  velocity  in  the  system. 

Thus  no  change  need  be  made  in  the  isoclines  or  delta  fxmction  used  in  the 
construction  of  the  phase  portrait  of  the  autonomous  system.  The  method 
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appears  to  be  of  pronise  as  an  approx^jnation  technique  for  forced  second- 
order  systems  but  requires  further  experience  before  it  can  be  recommended 
as  a  method  for  obtaining  proof  of  compliance  to  performance  specifications. 
Gibson  [77]  works  several  examples,  but  his  presentation  is  not  complete  or 
exhaustive • 

5.3  Time  Optimum  (Switched)  Nonautoncmous  Systems 

Although  most  studies  of  the  optimum  control  problem  restrict  themselves 
to  the  autonomous  system,  a  few  workers  have  considered  the  more  difficult 
problem  of  time-optimum  nonautoncmous  systems.  Amoxing  these  are  Krasovskii 
[79]  s  Kalman  and  Koepeke  [SO]  ,  LaSalle  [20]  and  Fuller  [8]]  . 

LaSalle  has,  developed  a  number  of  basic  theorems  for  forced,  time  vary¬ 
ing  parameter,  time  optimum  control  systems,  but  he  does  not  discuss  the 
engineering  implications  of  his  work.  Kalman  and  Koepeke  point  out  certain 
of  the  implications  of  such  systems,  and  Fuller  further  clarifies  the 
situation. 

It  is  no  longer  sufficient  in  general  to  use  only  the  state  variables 
of  the  autonomous  system  for  the  description  of  the  forced  system.  The  state 
variables  to  be  fed  into  the  logic  element  or  controller  must  now  consist  of 
a  state  description  of  the  plant  plus  a  state  description  of  the  input 

-  [A(t)]fx(t)}  +  [B(t)][u(t)}  *  (5-1) 

It  must  be  pointed  out  that  this  formulation  of  the  equations  of  a  non¬ 
linear  closed  loop  system  ^  not  complete.  A  further  nonlinear  relation 
will  be  required  to  relate  |^x(t)J-  and  ^u(ti^  .  For  example  in  the  system  in 
Figure  3.1,  it-  will  be  found  convenient  to  identify  the  state  variables  with 
error,  the  steering  function  with  ra,  and  the  forcing  function  with  the  input. 


Thus  in  matrix  form 
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{^e(t)}  »  [A^t)][  «(t)]  +  ^5-2) 

where  f(t)  of  equation  5-1  is  now  say  g(r)  s  h(t) 

Now  m  »  f(e)  sayo  It  will  be  impossible  to  substitute  this  relation  into  the 
matrix  formulation  and  manipulate  because  matrix  algebra  is  a  linear  algebra. 
Thus  the  matrix  relation  is  an  open  loop  description  of  a  portion  of  the  sys¬ 
tem®  When  the  nonlinear  relation  is  considered  after  the  matrix  manipula¬ 
tions  are  ccmpletcj,  the  most  difficult  problem  still  renainso  Most  authors 
ignore  this  problem  completely  although  a  few  of  the  bravest  acknowledge  its 
existence®  None  solve  it® 

In  order  to  define  the  optimum  trajectory  and  the  optimum  switching 
boundaries  in  the  methods  discussed  in  the  literature  the  input  must  be 
defined  in  the  form  of  a  differentiable  fxinctionj  e®g®  a  polynomial®  This 
is  a  restriction.  Note  that  under  these  conditions  the  optimum  switching 
boundaries  are  directly  dependent  upon  the  description  of  the  input  signal® 
This  means  that  the  complexity  of  the  system  will  rise  rapidly  if  this 
approach  is  followed  with  the  result  that  all  insight  will  be  lost®  Second¬ 
ly,  since  the  optinrom  design  is  uxd.quely  tied  to  the  defined  input  state 
coordinates,  even  if  it  could  be  instrumented,  the  system  would  be  useful 
for  only  the  one  input  for  which  it  was  designed®  Of  co\irse  this  situation 
is  impossible®  For^'-\mately,  however,  several  alternative  schemes  present 
themselves® 

Kalman  and  Koepcke  [80]  suggest  that  the  actual  input  be  approximated 
with  a  curve  of  given  degree  ove/:  given  segments  of  time®  Then  tne  co¬ 
efficients  of  the  approximating  polynomial  need  be  found  only  once  per  time 
segment®  These  numbers  could  be  entered  into  the  optimrum  switching  curve 
calculations,  thus,  the  switching  boundaries  could  be  recalculated  once  each 
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segment.  The  concept  of  switching  boxindaries  in  the  state  space  for  a 

nonautonomous  system  appears  in  reality,  however,  to  be  a  rather  cumber- 

saae  one  and  perhaps  deserves  to  be  abandoned  for  a  more  sophisticated 

approach.  Bellman  suggests  that  the  concept  of  a  multistage  decision 

policy  or  dynami c  programming  is  directly  applicable  here  [54] • 

The  philosophy  of  approach  is  as  follows,  A  general  performance  index 

or  payoff  function  is  defined  in  terms  of  the  system  state  variables  and  the 

state  description  of  the  input, 

00 

r 

IP  ■  Q  (x2^,X2,3^,,,,Xjj,r2^,r2  ,,,.,rjj)dt  (5-3) 

o 

At  given  instances  of  time  the  question  is  asked,  which  state  of 
the  relay  will  optimize  the  IP  at  this  time?  The  question  is  asked 
sequentially  in  time  and  the  relay  adjusted  accordingly  as  the  solution 
proceeds.  So  long  as  the  system,  described  in  terms  of  the  state  variables, 
possesses  the  Markovian  Property  (  [54] ,  p*  54)  (that  is,  we  do  not  have 
time  delays  nor  a  "delay  differential  equation"  to  describe  the  system) 
Bellman  has  shown  that  a  sequence  of  such  optimum  decisions  is  optimum 
overall,  Natiirally  the  engineering  implementation  of  such  a  scheme  is 
considerably  more  complex  than  this  naive  description  might  indicate,  and, 
in  fact,  engineering  feasibility  studies  of  it  are  only  now  being  initiated 
in  various  engineering  research  laboratories.  Without  doubt,  thj.s  is  a 
most  challanging  area  for  future  research  and  ties  in  directly  with  the 
already  wide  spread  activity  on  the  concept  of  adaptive  control, 

5,4  Response  of  Nonlinear  Systems  to  Randan  Inputs 

The  response  of  a  certain  class  of  nonlinear  systems  to  randcoi  inputs 
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has  been  investigated  by  some  researchers.  Considerable  effort  has  been 
expended  in  investigating  the  theory  of  nonlinear  filters.  Wiener  [S2] 
considers  the  response  of  a  particular  type  of  nonlinear  filter  to  Brown¬ 
ian  motion  input.  The  type  of  filter  to  which  Wiener's  method  is  applicable 
is  the  one  in  which  it  is  possible  to  separate  the  filter  into  two  distinct 
blocks  in  tandem,  one  block  being  linear  and  the  other  nonlinear  of  the 
functional,  instantaneous  (non  memory)  type,  Wiener  shows  that  the  know¬ 
ledge  of  the  Brownian  motion  response  of  such  a  33rstem  is  sufficient  for 
the  determination  of  its  response  to  any  other  input.  The  application  of 
this  theory  to  the  investigation  of  the  response  of  a  nonlinear  feedback 
system  is  not  known  at  the  moment.  Bose  [$3]  also  considers  the  probl«n 
of  determining  the  response  to  random  inputs  of  a  filter  similar  to  the 
one  treated  by  Wiener. 

The  determination  of  sooie  statistical  characteristics  of  the  output 
of  certain  nonlinear  nonclosed  loop  systems  with  random  inputs  is  consider¬ 
ed  by  Rice  [84]  ,  Laning  &  Battin  [85]  and  Sridhar  [53]  . 

The  problem  of  analysis  and  synthesis  of  nonlinear  feedback  systems 
subject  to  stochastic  inputs  is  certainly  a  wide  open  area  for  research 
and  warrants  considerable  effort.  This  is  evident  when  one  considers  the 
work  of  Wiener,  since  this  provides  a  fresh  viewpoint  to  the  whole  problem 
of  analysis  and  synthesis  of  nonlinean*  systems.  At  the  present  Wiener’s 
work  is  not  applicable  to  any  but  the  most  trivial  practical  cases. 
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